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//from the editor/ 






Innovation is the lifeblood of our industry— so said Java Community Process Executive Committee 
member Ben Evans in our interview . And often where there is innovation, there is Java. In this issue, we cel¬ 
ebrate the innovative use of Java by profiling the winners of the 2012 Duke's Choice Awards. For this 10th year 
of the awards, the judging criteria themselves got a little innovative: while the majority of winners were rec¬ 
ognized for their technological innovations using Java, two Java user groups (JUGs) were recognized for their 
innovative approach to bettering the Java community. By acknowledging these JUGs, the awards demonstrate 
that Java remains a user-driven, not vendor-driven, phenomenon. Meet all of our winners. 

Speaking of innovators, our cover story features another Duke's Choice Award winner, Liquid Robotics. As 
chief software architect, Java pioneer James Gosling is rewriting (in Java) the onboard software for the Wave 
Glider, a marine robot used for gathering ocean data. While visiting his longtime friend Bill Vass at Liquid 
Robotics, Gosling thought the technology was so cool that he asked him for a job. Learn more in "Java at Sea." 

Java SE 8 is on its way and full of new innovations, including lambda expressions. Read our interview with 
Java Language Architect Brian Goetz, "Looking Ahead to Project Lambda.," to find 
out how lambda expressions will change the way you code. 

Innovation also brings change. While Justin Kestelyn, ourfounding editorin chief, 
has moved on to other community-building opportunities, we are committed to 
making Java Magazine better with every issue. I am honored to take the reigns from 
Justin and am thankful for his countless contributions. 

I hope to see many of you atJavaOne (where you'll definitely find innovation). 


//send us your feedback / 

We'll review all 
suggestions for future 
improvements. 
Depending on volume, 
some messages may 
not get a direct reply. 


Caroline Kvitka, Editor in Chief ^ 
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FINDYOUR 
JUG HERE 

My local and global JUGs 
are great places to network 
both for knowledge and work. 

My global JUG introduces 
me to Java developers all 
over the world. 

Regina ten Bruggencate 
JDuchess 
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The University 
of Kent’s 
Michael Kolling 
(left) describes 
Greenfoot 
programming; 
future developers 
get hands-on 
experience. 



MAKE THE 
FUTURE JAVA 



More than 300 San Francisco Bay Area students partici¬ 
pated in "Make the Future Java," a two-day interactive 
workshop August 7-8 created to inspire students' love 
of technology and computer science and to help spark 
the next generation of Java developers. Professors from 
Carnegie Mellon University and the University of Kent 
led hands-on sessions using Alice (visual 3-D educa¬ 
tional software for creating animations) and Greenfoot 
(visual 2-D educational software for creating games and 
simulations). The Oracle Education Foundation recently 
awarded grants to Carnegie Mellon's Alice program 


and the University of Kent's Greenfoot initiative to help 
awaken student interest and promote a love of com¬ 
puter science, technology, and Java in future technolo¬ 
gists and innovators. "As the steward of Java, Oracle is 
committed to the investment in Java technology and in 
creative ways to educate a new generation about Java 
and the opportunities it brings," says Alison Debenwick- 
Miller, vice president of Oracle Academy. "Our next gen¬ 
eration of future technologists and innovators have been 
given a great start." Learn more about Oracle's Make the 
Future Java initiative. 
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JAX Innovation 
Awards 2012 



The 2012 JAX Innovation 
Award winners were 
announced on July 10 at 
the JAX Conference in San 
Francisco, California. The 
awards celebrate the cul¬ 
ture of innovation in the 
Java ecosystem. The win¬ 
ners are selected in a three- 
step process: the developer 
community nominates 
candidates, an indepen¬ 
dent expert panel selects 
five finalists in each award 
category, and the developer 
community votes. 

The 2012 winners 
received a USS2,500 prize. 
This yea r's win ners were 
Restructured (Most 
Innovative Java Technology); 
JetBrains (Most Innovative 
Java Company); Adam Bien 
(Top Java Ambassador, 
above left); and Charles 
Nutter (Special Jury Award, 
above right). 

PHOTOGRAPHS BY PIOTR MALECKI/GETTY IMAGES, 
MARKUS EISELE 
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TDC: 

THE DEVELOPER’S 
CONFERENCE 


Hkti 




Kj 


* 


More than 3,400 developers attended the Developer's Conference (TDC) 
in Sao Paulo, Brazil, in July. This five-day event, organized by Globalcode, 
is considered the premier multicommunity developer conference in Brazil. 
"We like to say multicommunity rather than multitechnology because it is 
interesting and beneficial when various communities get together," says 
Yara Senger, one of the organizers. "Each community has its own personal¬ 
ity, and they learn a lot from each other." 

TDC featured more than 250 speakers across 37 tracks. New this year at 
TDC was the Java Universi ty trac k, sponsored by Oracle. Aimed at university 
students and professionals new to Java, this track included introductory- 
level lectures that had an educational focus, as well as practical exer¬ 
cises. Members of Brazilian Java user groups including Gojava, JavaB ahia . 
JavaNoroeste, and Soujava lent their expertise to the Java, SOA, Python, 
Ruby, mobile, and digital TV tracks to make this a successful and edu¬ 
cational event. In the mobile track, developers—including a 15-year-old 
student—who created a Java ME app received a Nokia phone. 

At the TDC opening keynote, Debora Palermo, Oracle University country 
manager for Brazil, discussed Oracle's Workforce Develo pment Pro gra m 
(WDP), which allows educational institutions to deliver Oracle training. 
WDP enables easy and low-cost access to Oracle training in local com¬ 
munities around the world. "Oracle University is committed to creating 
the next generation of Java developers, and WDP can make that happen," 
Palermo said. Oracle University is p artnering with Globalcode to offer WDP. 
Students can earn official Oracle Course Certifications through WDP. 


niversidac 

nhemtl 
morumU 


cri<rtiva e ■ * 


TDC track owners 
and conference 
collaborators on 
stage on the final 
day (top); Oracle 
University’s Debora 
Palermo talks about 
training programs. 


Open Data, 
Government, and 
Transparency 


The open data movement is growing 
worldwide. One initiative, the Open 
Government Partnership, is working 
to make it easier for the public to find 
and access government data from 
around the world. 

■Brazil, 

a new track called Open Data focused 
on what a developer needs to know to 
build applications using open data. 
Track leaders presented successful 
open data projects and discussed the 
Semantic Web, big data sets, data visu¬ 
alization, and designing APIs. 

The track finished with a full 
Transparency Hacker Day devoted to 
creating applications using existing 
open government data, includingthe 
Brazilian government's release of most 
officials' salaries. Participants created 
an application called Serve o Quanto 
Ganha (Worth What You Earn), which 
looked at two public employees and 
compared how many salaries ofXare 
needed to pay Y's salary. 

Learn more about open data at the 
U.S. government open data project, 
the Brazilian government open data 
project, the U.K. government open data 
project, and the 2012 International 
Open Government Data Conference. 


1 
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Georges 


2012 JVM LANGUAGE SUMMIT 


Saab 


The 2012 JVM Language Summit, held at Oracle's 
Santa Clara, California, campus July 30-August 1, 
brought together the world's leading Java Virtual 
Machine (JVM) language architects. As one attendee 
tweeted, "If the building collapses, progress in lan¬ 
guage innovation will be set back by 100 years." The 
air was crackling with code. 

Speakers included Georges Saab (introduction), 
William Cook (batches), Mark Roos (RTalk), Matt 
Fowles (staged compilation), Jochen Theodorou 
(Groovy, invokedynamic), Oracle's John Rose (arrays) 
and Brian Goetz (Project Lambda), Dan Heidinga 
(MH introspection), Lukas Stadlar (Truffle), Per 
Bothner (Kawa), Jeroen Frijters (CLR/JVM), Duncan 


MacGregor (migrating to JVM, ASM), Rich Hickey 
(Datomic), David Chase (Fortress), Remi Forax 
(JDart), Basil Hosmer (Mesh), Ryan Sciampacone 
(multitenant JVM), Jim Laskey (JDI), Doug Simon 
(Graal), Michael Wiedeking (AL1 JVM Assembler), 
Andrey Breslav (Kotlin/Java interoperability), Gilles 
Duboscq (Graal), and Donald Raab (collections). 

"It's one of the best conferences I've ever seen," 
remarked one attendee. "No commercials, no sales, 
just a communal focus on technology in a spirit of 
open learning and curiosity. Here are the people who 
invent programming languages." Another wore a 
T-shirt that said, "Changing lives one line at a time." 

Videos of presentations are available online. 


PHOTOGRAPHS BY OLEG PLISS 


The JCP: 

Open and 

Transparent 

The JCP.NextJSRs mandate new 
openness and transparency for 
the Java Community Process 
(JCP). For example, JSR 348 
requires that the JCP invite the 
global public to two Executive 
Committee (EC) meetings each 
year. The first of these was held 
on June 26. Learn more in the 
meetin g mi nutes. 

The JCP will be busy at 
JavaOne. It will host four ses¬ 
sions: JCP.Next: Reinvigorating 
Java Standards; 101 Ways to 
Improve Java: Why Developer 
Participation Matters; Meet 
the JCP Executive Committee 
Candidates; and The JCP and 
OpenJDK: UsingtheJUGs' 
Adopt Programs in Your Group. 
The JCP will also hold three 
events: JCP EC Face to Face 
Meeting; JSR Expert Group Spec 
Lead Gathering; and the JCP 
party on October 2, where the 
10th JCP AnnuaJ_Awaids will be 
presented. This year's award 
categories are JCP Member/ 
Participant of the Year, 
Outstanding Spec Lead, and 
Most Significant JSR. 
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FEATUREDJAVA.NET PROJECT 


VISUALLANGLAB 


VisualLangLab is the world's first 
fully visual, code/script-free 
parser-generator integrated 
development environment (IDE). 

It depicts grammar rules as trees 
containing nodes with intuitive 
icons. These "rule trees" can be 
run instantly at the click of a but¬ 
ton without code generation or 
any other intermediate step. The 
visual representation enables 
even users without special skills 
to utilize VisualLangLab to create 
sophisticated parsers. These pars¬ 
ers can be embedded into cli¬ 
ent programs written in any java 
Virtual Machine language. 

VisualLangLab was highlighted 
in Java Posse Episode 364. The 
Posse noted, "If you are observ¬ 
ing the crop of new languages 
springing up at present and think 
to yourself, 'I could do better than 
that,'well, now'syourchance. 
VisualLangLab is a graphical tool 
for designing language grammar. 
And it's not just for full-blown 
languages. The project could be 
used fordevelopingfree-form 
domain-specific languages." 


The VisualLangLab project 
was started in January 2011, 
but its roots go back to 2004 
when founder Sanjay Dasgupta 
was leading a team in develop¬ 
ing a tool chain for a custom 
business-oriented language. As 
the work progressed, Dasgupta 
realized that the classic parser- 
generators (ANTLR, JavaCC) were 
too complex for many users. 

So Dasgupta began working on 
VisualLangLab's predecessor. 

To date, more than 1,400 
developers have downloaded 
VisualLangLab. Through all the 
years of development effort, 
Dasgupta has been the proj¬ 
ect's only developer. He cites the 
complexity of the code as being 
a likely deterrent to other devel¬ 
opers. However, he is trying to 
ease the path for people who 
might like to join the project by 
supplementingthe code's internal 
documentation. 

Learn more in "VisualLangLab— 
Grammar Without Tears" and visit 
the project on Java.net for a 
tutorial, FAQs, and more. 
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JAVA CHAMPION PROFILE 

® KIRK PEPPERDINE 


Java Magazine: W h e re 

did you grow up? 
Pepperdine: I was born 
in Ottawa, Ontario, 
Canada; started school 
in Clinton, Ontario; 
moved to Saint John, 
New Brunswick; and 
then back to Ottawa. 
Java Magazine: How 
did you first become 
interested in 
programming? 
Pepperdine: My fi rst 
year of biochemistry 
ended in an economic 
downturn. I had no 
summer job, so I 
enrolled in a program¬ 
ming course. It just 
clicked. I started using 
computers to help me 
do my biochem labs. 
Java Magazine: What 
wasyourfirst program¬ 
ming language? 
Pepperdine: The first 
language was PL/C 
on an IBM 370, but 
I quickly switched 
to using Fortran for 
schoolwork. My first 
professional language 



was BASIC. 

Java Magazine: What 
wasyourfirst program¬ 
ming job? 

Pepperdine: When I 
started working as a 
biochemist, I had to do 
a lot of programming. 
In one memorable 
experiment, we wrote 
software to control a 
pressure relief valve 
fora high-frequency 
oscillator ventila¬ 
tor circuit. We had to 
burn the program into 
a ROM on a chip that 
ran Tiny BASIC. Input 
came from another 
Intel chip that created 
a digital signal from 
air pressure. The two 
chips and a solenoid 
were all wire-wrapped 


onto a board and then 
put into the airway 
circuitry. An airway is 
warm, very moist, with 
salty air. The board 
would work for about 
four hours, after which 
I had to wash, dry, and 
then autoclave it. That 
was a lot of fun. 

Java Magazine: What 
are you looking for¬ 
ward to in the coming 
years? 

Pepperdine: 

Continuing my efforts 
to change peoples' 
ideas on howto tune 
applications. I've 
recently started a 
performance tooling 
company called 
jClarity. We are build¬ 
ing some experimental 
software that doesn't 
look like anything else 
out there. 

Read more about Kirk 
Pepperdine and visit 
Kodewerk for informa¬ 
tion on his Java perfor¬ 
mance tuning courses. 




































JAVA USER GROUP PROFILE 

MoroccoJUG 

MoroccoJUG— the onlyjava usergroup (JUG) in 
Morocco—was founded in early 2009 by Badr 
Elhouari (technical expert at Safran Morpho) and 
Faissal Boutaounte (technical leader at Strategum 
SARL). Although the JUG is located in Rabat, 
its activities extend to Casablanca, Marrakech, 
Mohammadia, Tangier, and other cities. 

MoroccoJUG has three main objectives: discuss- 
ingjava and strengtheningthejava community 
in Morocco; helping universities and engineering 
schools educate students about Java and related 
technologies; and helping to move Java forward in 
Morocco and around the world. 

MoroccoJUG also seeks to organize and 
growthe Moroccan developer community and 
enhance its global recognition through informa¬ 
tive monthly meetings and the Java Education 
Moroccan Initiative (JEMI). JEMI provides Java 
courses to students in their graduation year. 

PHOTOGRAPHS COURTESY OF MOROCCOJUG 


The courses have led to higher attendance at 
MoroccoJUG meetings, with membership grow¬ 
ing to 700 people in less than three years. 

Another major focus for the MoroccoJUG 
leaders is global outreach. MoroccoJUG was one 
of the first JUGs affiliated with the JUG-Africa 
umbrella group, contributing to the ICertif effort 
from its inception. The JUG is active in the Adopt- 
a-JSR_program and is one ofthreeJUGs that vol¬ 
unteered to work in the AdoptOpenJDK Bugathon 
Instructors Training pilot initiative. 

MoroccoJUG actively participates in major 
Java conferences such as Devoxx, Jfokus, Java 
Developer Conference, and the IOUC Summit. 
The JUG is organizing an international Java event 
called JMaghreb that will be one of the biggest 
Java technology events in North Africa. 

Learn more on Java.net orTwitter 
( @m oroccoiug). 


MoroccoJUG 
members 
filled the room 
at a recent 
meeting. 


ECLIPSE JUNO 
RELEASED 

The Eclipse Community 
released its latest version, 
code-named Juno, in late 
June. This continued a nine- 
yeartradition of annual 
releases of the Eclipse suite 
in June. Seventyione 
projects, including nine 
new projects, make up the 
Juno release. 

At Juno's core is Eclipse 
version 4.2. Important 
new features include Code 
Recommenders, which sig¬ 
nificantly smartens Eclipse 
code completion; a new 
Nano kernel for the Virgo 
Web server, which facili¬ 
tates building very small 
OSGi-based applications; 
and added support in Xtext 
for integrated debugging of 
domain-specific languages 
created using Xtext. 

The Eclipse Juno repre¬ 
sents the work of 445 open 
source committers on 55 
million lines of code, and 
the participation of more 
than 40 Eclipse member 
companies. 



co 


i- 

=) 

o 

co 

< 



f 


(JF) 


java 

.net 


\ 

blog 

s._ ) 




ORACLE.COM/JAVAMAGAZINE /////////////////////////////// SEPTEMBER/OCTOBER 2012 

















































//java nation / 


LAMBDA EXPRESSION: 


Music to 
Program By 


In response to 
last issue's call 
forjava songs, 
Freddy Guime 
told us about 
his one-man 
band, Lambda 
Expression, and 
pointed us to 
its current song catalog. Guime's 
latest (and his favorite) song is 
the edgy " In the Zone. " where he 
sings about those wonderful (if 
rare) programming days where 
everything just flows, the code 
is seeming to almost write itself, 
and the last thing you want is 
to be interrupted by meetings, 
e-mail, and life. Guime also blogs 
and posts podcasts at Java Pub 
House. Do you have a Java song? 
Share it with us! 



OSCON Offers 
Hard and Soft Skills 

OSCON, the open source convention, was held 
in Portland, Oregon, in July. With more than 
3,600 attendees and more than 4,600 virtual 
attendees watching the live stream, OSCON 
provided great information about open source 
technologies, communities, and strategies. 
Java was well represented with the sessions 
High Pe rformance Network Programming 

on the JVM; Hacking JavaFX with G roovy, 
Clojure, Scala, and Visage: The Art of 
Meta pro gra mming in Java; and The lava EE 7 
Platform: Develo ping for the Cloud. OSCON 
included a focus on "soft skills," with tracks 
for Community and Geek Lifestyle. Sessions 
such as Open Source 2.0: The Science of 
Comm unity Majnagement and Analyzing How 
Developers Learn Online f or Fun an d Profit 

reminded developers that coding chops can 
get you into an open source community, but 
how you interact with others has a big impact 
on your long-term success. Speaker slides and 
videos are available at oscon.com. 



David Eaves on the science of open source 
community management 
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There are a lot of excellent Java 
and Java Virtual Machine (JVM) 
technology blogs out there. But if you want to stay 
informed on current news and what's coming up in 
the future, subscribing to these five blogs is a great 
way to start: 

D Adam Bien's Weblog: Adam Bien— Java 
Champion, author, and consultant—covers 
almost all things Java in his blog, with a particular 
focus on Java EE. 

FX Experience (JavaFX News, Demos and 
nsight): Jonathan Giles provides JavaFX news, 
interviews, links of the week, release announce- 
ents, and programming tips. 

Geertjan's Blog (Random NetBeans Stuff): 



me 

E 


Geertjan Wielenga, Oracle DeveloperTools prin¬ 
cipal product manager, says that he focuses his 
posts on "NetBeans, with an occasional reference 
to NetBeans, and sometimes diverging to topics 
relating to NetBeans. And then there are days when 
NetBeans is mentioned...." 

Inspired by Actual Events (Dustin's Software 




Development Cogitations and Speculations): 
Developer Dustin Marx shares his observations on a 
wide range oftopicsincludingjava, the JVM, JavaFX, 
and Groovy. 

There's not a moment to lose!: Oracle Java 
Platform Chief Architect Mark Reinhold doesn't 
post frequently, but when he does, it's often signifi¬ 
cant news. 
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EVENTS 

Java Em bedd ed @ JavaOne OCTOBER 3-4, 

SAN FRANCISCO, CALIFORNIA 

At Java Embedded @JavaOne, C-level executives, 
architects, business leaders, and decision-makers 
from around the world come together to learn 
howjava Embedded technologies and solutions 
offer compelling value and a clear path forward to 
business efficiency and agility. This new program 
at JavaOne features dedicated business-focused 
content that delves into howjava Embedded 
delivers a secure, optimized environment ideal for 
multiple network-based devices, while industry- 
focused sessions show howjava Embedded tech¬ 
nologies are being successfully utilized. 


PHOTOGRAPH BY ELIJAH MERCHAN 


OCTOBER 

Silicon Valley Code Camp 

OCTOBER 6-7 
LOS ALTOS HILLS, 
CALIFORNIA 

At this community event, 
developers learn from each 
other. Featured topics include 
software branding, legal 
issues around software, and 
much more. All are wel¬ 
come to attend and speak. 
More than 2,000 developers 
attended in 2011. 

JDC2012 Goiania 

OCTOBER 20-21 
GOIANIA, BRAZIL 
The Developer's Conference, 
orTDC, is a multicommunity 
developer conference with 
locations throughout Brazil. 
Tracks include Java, SOA, 
Mobile, and more. 

QConHangzhou 

OCTOBER 25-27 
HANGZHOU, CHINA 
This enterprise software 
development conference 
is designed for team leads, 
architects, and project man¬ 
agers and is organized by and 
for the community. Topics 
include architecture, func¬ 
tional languages, mobile, and 
agile engineering practices. 
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NOVEMBER 

WJAX 

NOVEMBER 5-9 
MUNICH, GERMANY 
W-JAX: The Conference for 
Java, Web, Architecture, Agile, 
and Cloud, presents a holistic 
approach to Java technologies. 
Topics include software archi¬ 
tecture, agile management 
methods, and issues of enter¬ 
prise architecture. 

QCon San Francisco 

NOVEMBER 7-9 
SAN FRANCISCO, CALIFORNIA 
This practitioner-driven con¬ 
ference is designed for team 
leads, architects, and proj¬ 
ect managers. The program 
includes two tutorial days and 
three conference days with 
18 tracks on a wide variety of 
software development topics. 

Devoxx 

NOVEMBER 12-16 
ANTWERP, BELGIUM 
This annual European Java 
conference is organized by 
the Belgian Java User Group. 

It features a two-day in-depth 
Devoxx University program, 
followed by three days of con¬ 
ference sessions. Hands-on 
labs and Birds-of-a-Feather 
sessions are on the agenda. 


COMING SOON: 

JDAYS 

B A newjava 
conference, 
iDavs. wi 11 
take place 
December 

Gothenburg, Sweden. The 
first two days of the confer¬ 
ence feature a lineup of ses¬ 
sions, with a unique twist: 
the community can vote 
on which session abstracts 
they find most interesting, 
and see the current results 
on the jDays home page. 

Day 3 of the conference 
also offers something dif¬ 
ferent: a full day of free 
courses and hands-on 
training. Conference co¬ 
organizer Hamid Samadi 
(above), who founded the 
GothenburgJavaforum user 
group in 2005, will lever¬ 
age his experience as an 
entrepreneur and trainer by 
actively participating in the 
jDays Day 3 activities. 
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HADOOP: THE DEFINITIVE 

GUIDEJH1RD EDITION 

By Tom White 
O'Reilly Media (May 2012) 
Ready to unlock the power 
of your data? With this 
comprehensive guide, you'll 
learn howto build and 
maintain reliable, scalable 
distributed systems with 
Apache Hadoop. This book 
is ideal for programmers 
looking to analyze data sets 
of any size, and for admin¬ 
istrators who want to set up 
and run Hadoop clusters. It 
includes case studies that 
demonstrate how Hadoop 
is used to solve specific 
problems. This third edition 
covers recent changes to 
Hadoop, including material 
on the new MapReduce API, 
as well as MapReduce 2 and 
its more flexible execution 
model (YARN). 



GUjMEET 


a J 

OCA JAVA SE 7 PROGRAMMER 

I STUDY GUIDE (EXAM 

1Z0-803) 

By Robert Liguori and 
Edward Finegan 
Oracle Press (October 2012) 
This book offers complete 
coverage of the updated 
Java SE entry-level pro¬ 
grammer certification exam 
and provides in-depth, up- 
to-date coverage of all the 
exam objectives. It offers 
an integrated study system 
based on proven peda¬ 
gogy—step-by-step exer¬ 
cises, Exam Watch, Inside 
the Exam, and On-the-job 
notes. In addition, chapter 
self-tests help reinforce 
and teach practical skills 
while preparingyou for 
the exam. The included 
MasterExam practice exam 
software features more 
than a hundred questions. 



% ■ 


KINECT OPEN SOURCE 
PROGRAMMING SECRETS: 

HACKING THE KINECT WITH 

OPENNI, NITE, AND JAVA 

By Andrew Davison 
McGraw Hill Professional 
(April 2012) 

The Kinect motion-sensing 
device for the Xbox 360 
and Windows became 
the world's fastest-selling 
consumer electronics 
device when it was released 
(8 million sold in its first 
60 days) and won the 
T3 Gadget Awards 2011 
Gaming Gadget of the Year. 
Learn howto harness the 
Kinect's powerful sensing 
capabilities for gaming, sci¬ 
ence, multimedia projects, 
and more on platforms 
running Windows, Mac OS, 
and Linux. 



PRO JAVASCRIPT FOR 

WEBAPPS 

By Adam Freeman 
Apress (June 2012) 

This book gives you all of 
the information you need 
to create professional, 
optimized, and efficient 
JavaScript applications that 
will run across all devices. 

It takes you through 
all aspects of modern 
JavaScript application cre¬ 
ation, showingyou howto 
combine JavaScript with the 
new features of HTML5 and 
CSS3 to make the most of 
the new Web technologies. 
The focus of the book is on 
creating professional Web 
applications and ensuring 
that your app provides the 
best experience foryour 
users, with smooth and 
responsive control 
and feedback. 



JAVA EE_6 POCKET GUIDE 

By Arun Gupta 

O'Reilly Media (September 2012) 
This guide provides an 
overview of the main tech¬ 
nologies in the Java EE 6 
platform, including exten¬ 
sive easy-to-understand 
code samples that demon¬ 
strate many improvements. 
Whetheryou're familiar 
with Java EE 5 or a Java 
programmer approaching 
the enterprise edition for 
the first time, this book will 
quickly get you up to speed 
on Java EE 6. You'll discover 
how Java EE 6 provides a 
simplified developer expe¬ 
rience and improves on 
the developer productivity 
features introduced in Java 
EE 5. You'll also delve into 
Java EE 6 profiles. 
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JCP Executive Series 

A Conversation with Ben Evans 


London JUG representative Ben Evans discusses the JCP 
and the Java community. BY JANICE]. HEISS 


PHOTOGRAPHY BY JOHN BLYTHE 


I n the second of a series of interviews 
with distinguished mem bers of the 
Executive Committee of the Java 
Community Process (JCP), we sat down 
with London, England, Java user group 
(JUG) representative Ben Evans, who 
has been a professional developer and 
open source enthusiast since the late 
'90s. Evans was the lead performance 
testing engineer for the Google IPO 
(the largest auction ever conducted), 
worked on the initial U.K. trials of3G 
networks with BT, built award-winning 
Websites for some of Hollywood's 
biggest hits of the '90s, rearchitected 
and reimagined technology that helps 
some of the most vulnerable people 
in the U.K., and has worked on every¬ 
thing from some of the U.K.'s very first 
e-commerce sites to multibillion-dollar 
foreign exchange trading systems. He 
is currently CEO ofjClarity, a London 
startup working on automation of Java 
performance tuning. 

Evans is the coauthor, with Martijn 
Verburg, of The Well-Grounded Java 
Developer, which focuses on Java SE 7. 
He currently represents London's JUG— 
the London Java Community (LJC)—on 
the Executive Committee of the JCP. 
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LJC Wins a 
Duke’s Choice 
Award 



Duke’s Choice 
Award 

2012 Winner 


Java" 


The London Java Community 
(LJC) is the winner of a 2012 
Duke’s Choice Award, which 
celebrates “extreme innovation in 
the world of Java Technology” 
and is granted to the most- 
innovative projects that use the 
Java platform. The LJC was 
recognized for its work in advanc¬ 
ing the Java ecosystem, including 
growing a large and vibrant JUG 
community, being the first JUG to 
have a seat on the JCP Executive 
Committee, and spearheading the 
Adopt-a-JSR and Adopt 
OpenJDK programs. 



Java Magazine: Tell us about your 
involvement with Java, the London 
JUG, and theJCP. 

Evans: I've been programming in Java 
since 1998 and am currently CEO of 
jClarity, a London startup focusing 
on automation of Java performance 
tuning. I help run the London JUG, 
which was successfully elected to the 
Executive Committee of the JCP last 
year, and I've been involved with the 
JCP for nearly 18 months. 

I personally got involved with the 
JCP through involvement in the user 
group, where I met Martijn Verburg. We 
started writing a book together, and I 
started doing more public speaking and 
became more involved in the commu¬ 
nity generally. My involvement in the 
JCP developed out of that. I personally 
wanted our JUG to become more of a 


Ben Evans shared the stage with Oracle’s 
Brian Goetz (left) and Mark Reinhold 
at the Devoxx 2011 Java developer 
conference in Antwerp, Belgium. 


community participant. In my day job, 

I had moved from a position where Java 
was just one language among several 
that I used to a position where Java was 
my primary language, and I wanted to 
participate and help unlock more of the 
platform's potential. 

When we originally stood for elec¬ 
tion to the Executive Committee we 
quite reasonably thought, "There's no 
way we're going to be elected, because 
we're up against some really estab¬ 
lished players." We thought we might 
just stir things up a bit and perhaps 
stimulate some debate—but we hon¬ 
estly didn't think we'd win. So it was 
quite a surprise to us that we actually 
won—something of a happy accident. 
Java Magazine: How do you address the 
problem of the relationship between a 
JUG and the larger Java community? 
Evans: With Java, we have what is 
known as an iceberg problem. So even 
within a relatively engaged JUG, the 
percentage of people who aren't part 
of the JUG far exceeds the number 
who are. We have roughly 2,500 JUG 
members in London, and we estimate 
that we're reaching 3 to 5 percent of 
the Java developers in the area, which 
isincredibly small. 

So there is a vast iceberg of Java 
developers under the surface. I'm not 



o 

< 


< 

5 


~3 





CO 


I- 

=) 

O 

CO 

< 



f 


(JF) 


lava 

.net 


\ 

blog 

s._ ) 




ORACLE.COM/JAVAMAGAZINE /////////////////////////////// SEPTEMBER/OCTOBER 2012 






























ON DISRUPTION 

We thought we might 
just stir things up 

a bit and stimulate 
some debate—but we 


we’d win. 


The JCP’s Ben Evans believes that Java suffers 
from an “iceberg problem,” exemplified by the 
small percentage of London Java developers 
who are part of the London JUG. 


entirely sure what to do about that, 
but it's a reality. We discovered some¬ 
where around the summer and fall of 
2011 that there are plenty of 
multitalented people who 
were interested in specific 
JSRs and emerging Java 
technologies. 

Java Magazine: Who shows 
up atthe London JUG 
meetings? 

Evans: It's quite varied, with 
a lot of business represen¬ 
tation in financial services, 
insurance companies, and 
telcos, plus a lot of academ¬ 
ics with a growing number 
of undergraduates. More recently, we 
have people from the startup commu¬ 
nity that is taking hold in East London. 
Java Magazine: How can we increase 
participation in the JCP? 

Evans: We need to keep reminding 
people that we're here, and that the 
decisions and new standards that 
come out of the JCP will affect the 
future careers of every Java developer, 
and that the process and developing 
standards need their help. There are a 
number of ways to join—as an individ¬ 
ual, a company, or even a user group. 
And there are a number of ways to par¬ 
ticipate as a member. You can follow 
the progress of standards that you're 
particularly interested in and ensure 
that existing standards and OSS [open 
source software] projects are repre¬ 
sented in JSRs that touch on any pat¬ 


ents' prior art. You can blog about new 
standards and help raise awareness. 
I'm sure that better outreach, bet¬ 
ter communication, and trying to get 
more everyday developers involved will 
all lead to better standards. 

Too many Java developers have still 
never heard of the JCP or think that it 
went away after the Oracle acquisition. 
Java Magazine: In waI king the fine line 
between respecting standards and 
encouraging innovation, does the JCP 
err too far in one direction? 

Evans: Walking this tightrope is really 
difficult. Innovation is the lifeblood of 
our industry, but we need strong com¬ 
patibility requirements. Without them, 
we impose costs and externalities on 
developers and end users of the plat¬ 
form. Too much of that, and people 
will start leaving. I think the JCP mostly 
gets it right, but we still need to keep a 
close eye on those factors. 

Java Magazine: What is the best thi ng 
that has happened to the JCP recently? 
Evans: There's been a resurgence of 
interest in the JCP in the last year. 
There's lots of new blood, a new version 
of the process that specifically makes 
transparency a key principle, and new 
momentum for change—it's tough to 
pick just one thing. 

Java Magazine: Would you like to see 
any structural changes in the JCP? 
Evans: I think the moves to merge 
the two committees, and to revisit 
the most complex section of the 
JSPA [Java Specification Participation 
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At the Java Community Process 
(JCP), three JSRs—two still in the 
works—are increasing openness 
and transparency. 

JSR 348, also known as JCP 
.next.l, was completed in October 
2011 and focused on some small and simple but important changes 
that enhance transparency and enable broader participation. “We’re 
already seeing the benefits of these changes as new and existing JSRs 
adopt the new requirements,” remarks JCP Chair Patrick Curran. 

JSR 355, JCP Executive Committee Merge, which simply merges the 
two executive committees into one for greater efficiency and to encour¬ 
age synergies between the Java ME and Java SE platforms, will be 
completed later in 2012. 

JSR 358, also known as JCP.next.3, filed in June 2012, consti¬ 
tutes a major revision of the JCP. It will modify the Java Specification 
Participation Agreement (JSPA), the legal agreement that members 
sign when they join the organization, as well as the Process Document, 
and it will tackle a large number of complex issues, many of them post¬ 
poned from JSR 348. Due to its complexity, JSR 358 should be com¬ 
pleted toward the end of 2013 or possibly later. 

Topics to be addressed in JSR 358 include the role of inde¬ 
pendent implementations (those not derived from the Reference 
Implementation), licensing and open source, ensuring that new trans¬ 
parency requirements are implemented correctly, compatibility policy 
and Technology Compatibility Kits (TCKs), the role of individual mem¬ 
bers, patent policy, and IP flow. 

All JCP business is being conducted in the open and can be followed 
and participated in on java.net. 
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Agreement]—namely, the parts that 
deal with intellectual property and 
how it is handled in the JCP—are great 
ideas. These are the most important 
areas where change is overdue. 

In terms of practical changes, the JCP 
lacks a proper calendaring system to 
remind Executive Committee members 
when votes are in-flight. We certainly 
need to fix that. 

Java Magazine: Are you happy with the 
Expert Group processes in the JCP? 
What changes would you like to see 
take place? 

Evans: The trick here is to balance 
the autonomy of spec leads with the 
desire to have standard processes. 

My personal thoughts are that having 
standardized procedures—licenses 
for reference implementations, TCKs 
[Technology Compatibility Kits], and 
so on—can help, and that spec leads 
should be encouraged, but not man¬ 
dated, to use them. 

The JCP should be collaborating with 
the community, with the community 
providing raw material and feedback, 
so we can see what's catching on and 
where we need standards. A good 
example of this would betheJSON 
standards. We're in need of a decent 
JSON library to compete with other 
trendy languages that are perceived as 
having better growth. 

To help this collaboration, the LJC 
launched the Adopt-a-JSR and Adopt 
OpenJDK programs to directly connect 
ordinary developers with the groups 


working on new standards and new 
language technology. This ensures that 
new standards and features get early 
feedback from the end users who will 
ultimately end up using them in their 
day jobs foryears to come. 

We can't change the language 
willy-nilly, because it affects millions 
of developers and huge numbers of 
people in industry and business world¬ 
wide. So as keepers of the standards, 
we have to go slowly and carefully. We 
can't make changes at the internet 
speed of a language like Scala. On the 
other hand, new languages in those 
ecosystems can serve as a kind of lan¬ 
guage lab—we can find out what works 
and what doesn't. There is an upside 
to being forced to go slowly. 

Java Magazine: Finally, has Oracle 
delivered on the promise of increased 
transparency and openness in the JCP? 
Evans: All the indications I've seen 
have been positive. I have no 
complaints. </article> 


Janice J. Heiss is the Java acquisitions 
editor at Oracle and a technology editor at 
Java Magazine. 
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Data Quality Tools for Java 



Geocoding 


Address Verification & 
Standardization 


Email Address Verification 


Telephone Verification 


Name Parsing & Genderizing 


Web Services & APIs 


Duplicate Elimination 


BEFORE 


john smith iii phd 
melissadata corp. 
22382 Empresa 92688 
7145895200 
john@800miAL.con 


AFTER 


Melissa Data Corp. 


John Smith III PhD 



22382 Avenida Empresa Ste 100 


Rancho Santa Margarita, CA 92688-2112 


949-589-5200 


John@melissadata.com 


Delivery Indicator: Business 


^Highlights indicate added and/or corrected data. 


Realtime NCOA Link 
Change-of-Address 
Web Service 
available 


Now, finding the right data verification tools doesn’t have to be so puzzling. 
Melissa Data offers customizable APIs, Web services and enterprise appli¬ 
cations to match your budget and business needs. For solutions to cleanse, 
validate and standardize your contact data, we’re ready to help you find the 
perfect fit. 

Iffiultiplatform 
Request free trials at 

MelissaData.com/myjava or call 1-800-MELISSA 


Global address verification for 240 countries 
Clean and validate data at point-of-entry or in batch 
Correct misspellings, missing directionals, and confirm deliverability 
Enhance addresses with County, Census, FIPS, etc. 

Append rooftop lat/long coordinates to street addresses 
Update records with USPS and Canadian change of address info 


LSislikkElDATA® 


Your Partner in Data Quality 













































Liquid Robotics charts a new 
course with help from Java 
pioneer James Gosling. 

BY DAVID BAUM 


PHOTOGRAPH COURTESY OF LIQUID ROBOTICS 
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Longtime friends Bill 
Vass (left) and James 
Gosling are exploring 
the oceans at Liquid 
Robotics as president 
and CEO and chief 
software architect, 
respectively. 



SNAPSHOT 

LIQUID ROBOTICS, 
INC. 

Iiquidr.com 

Headquarters: 

Sunnyvale, California 

Industry: 

Maritime data 
collection, observation, 
monitoring, and 
exploration 

Employees: 

90 

Java technologies 
used: 

JDK7 with NetBeans, 
Swing, and the NASA 
World Wind Server 


PHOTOGRAPHY BY BOB ADLER 


"I ava's success is partially attribut- 
I able to its immense versatility. From 
J animating internet programs to 
powering cell phones, it's the most 
populartechnology language in the 
world. Some of the most interesting 
Java programs are embedded in scien¬ 
tific research equipment, such as the 
Wave Glider—the flagship product of 
Sunnyvale, California-based Liquid 
Robotics and one of this year's Duke's 
Choice Award winners (see "Duke's 
Choice Awards " on page 23). 

The Wave Glider is a self-propelled 
autonomous marine robot that taps 
the energy of ocean waves for propul¬ 
sion. Above water, it looks like a high- 
tech long board, a buoyant platform 
covered with solar cells and various 
types of test and measurement equip¬ 
ment. Down below is a submerged 
glider with wing-shaped panels that 


have been specially constructed to 
convert the up-and-down motion of 
waves into forward thrust. This pat¬ 
ented wave motion system permits 
the craft to travel indefinitely without 
relying on batteries or fossil fuels, as it 
only uses renewable energies. No fuel 
required, no personnel needed, and no 
harmful environmental emissions. 

Since James Gosling took over as 
chief software architect at Liquid 
Robotics, Java has played a progres¬ 
sively more important role in the mis¬ 
sions of these unique oceangoing 
robots in data transmission and analy¬ 
sis. Best known for his role as a com¬ 
puter scientist at Sun Microsystems, 
where he invented Java, Gosling is 
rearchitecting the onboard software 
and refining a data-as-a-service cloud 
to provide direct, real-time access to 
ocean information. 


LIFE'S CHANGES 

In September 2011, not long after leav¬ 
ing Oracle and a brief stint at Google, 
Gosling joined Liquid Robotics—a 
rapidly growing company he had heard 
about from his longtime friend and 
coworker Bill Vass, who now serves as 
president and CEO. 

"I visited Bill to see his new venture, 
and it was just so incredibly cool," 
Gosling recalls. "They had devised a 
way to obtain a wide variety of detailed 
ocean data more cheaply and perva¬ 
sively than by any other means. The 
Wave Glider involves an interesting 
data problem and a large-scale control 
problem, both of which have been pas¬ 
sions of mine foryears. So I asked him: 
'Do you have a job for me?'" 

Vass was quick to hire Gosling and 
turn him loose on a variety of chal¬ 
lenging projects. As chief software 
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DATA CENTER AT SEA 

“So much of our platform depends 

on software. Wave Gliders are 
like floating data centers on the 
ocean. They have a lot of onboard 
intelligence, which is connected 
via satellite to the cloud.” 

—Bill Vass, President and CEO, Liquid Robotics 


architect, Gosling is responsible for 
retoolinga numberofcommand and 
control systems and improving net¬ 
work communications, 
which entails uploading 
data from each mission to 
a cloud-based data reposi¬ 
tory. They are also creating 
a data visualization system 
for tracking, monitor¬ 
ing, and controlling Wave 
Glider missions. 

"So much of our plat¬ 
form depends on soft¬ 
ware," Vass says. "Wave 
Gliders are like floating 
data centers on the ocean. They have 
a lot of onboard intelligence, which is 
connected via satellite to the cloud." 


MODERN FABLE 

Each Wave Glidercan collect and 
transmit oceanic data on a continuous 
basis on missions that can last as long 
as a year and cover thousands of miles. 
To date, collectively Wave Gliders have 
traveled more than 250,000 nauti¬ 
cal miles around the world's oceans. 

"If you could imagine doing a leisurely 
stroll across the Pacific Ocean, that's 
what our robots do," explains Gosling. 

Traveling across the ocean on an 
average of 1 to 2 knots might seem 
like a tedious undertaking. But if you 
want to deploy a stationary monitor¬ 
ing system, the alternative is to hire 
an oceangoing ship to tote it to its 
destination, at a cost of US$50,000 to 
US$150,000 per day. Like the fable of 


Gosling updates Vass on reworking the 
Wave Glider’s onboard software in Java 
and developing a data-as-a-service cloud 
for real-time access to ocean information. 


the tortoise and the hare, Wave Gliders 
may be slower, but they are reliable, 
tireless, and have an inexhaustible 
source of energy at their disposal. 
"Slow" turns out to be perfect for sci¬ 
entific instruments: they can carefully 
collect dense data sets ratherthan 
speeding by and missing detail. 

From a cost perspective, slow 
and steady wins every time—a fact 
that has not escaped the notice 
of eminent research institutions 
such as the NationaJ_Oceanic and 
Atmospheric Admin istra tion. Woods 
Hole Oceanographic Institution, the 
Monterey Bay Aqu arium R esearch 

Inst itute , Scripps Institution of 
Oceanography, and the University of 
Hawaii, all of which now use Wave 
Gliders for oceanographic experiments. 

"Deep-water buoys are remarkably 
expensive, and the vast majority of 
that expense is due to getting out into 
the ocean to do deployment and main¬ 
tenance," Gosling explains. "If a glider 
needs maintenance, you send a new 
one out to replace it and the old one 
drives itself back to shore." 

Monitoring the weather is just one 
of many uses for the Wave Glider. The 
autonomous robots are also deployed 
for commercial operations such as off¬ 
shore oil and gas exploration, national 
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defense, and envi¬ 
ronmental operations 
such as monitoring 
water temperatures 
in the Arctic or mea- 
suringthe carbon 
levels in the ocean. 
Information gleaned 
from onboard instru¬ 
ments helps scien¬ 
tists to collect data 
about ocean cur¬ 
rents, predict hur¬ 
ricanes, detect oil 
spills, study marine 
life, and a host of other applications. 
Solar cells generate electricity for the 
computers and navigation systems as 
well as forlridium modems that link 
the crafts to shore. 

HANDS ON 

Gosling likes being back on a small 
development team where he can have 
his hand in the code. Most of the exist¬ 
ing Wave Glider's onboard software 
is written in C running on a small 
microcontroller. In some cases this 
framework has reached the limits of 
its complexity, so he and his team are 
systematically rewriting the command 
and control components in Java to run 
on a modern ARM processor. 

In addition, Gosling is using Java 
to develop a data-as-a-service cloud 
to provide a framework for integrat¬ 
ing customer applications. "It's hard 
to expand these C programs into 


SLOW AND STEADY 

“If you could 
imagine doing a 

leisurely stroll 
across the 

Pacific Ocean, 

that’s what our 
robots do.” 

—James Gosling, Chief 
Software Architect, 
Liquid Robotics 





PHOTOGRAPH COURTESY OF LIQUID ROBOTICS 


Clockwise from top right: a Wave Glider 
as seen from below; Vass and Gosling 
at Liquid Robotics’ headquarters, where 
large monitors display Wave Glider activity 
and data; Vass talks with members of the 
Liquid Robotics team in the Wave Glider 
piloting room; Vass and Gosling in the 
Wave Glider manufacturing area. 
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AIS Antenna 


Weatherstation •. 



FLOAT 


Command & 
Control Dry Box 


Forward Payload 
Dry Box 


Wings 


Solar Panel 


Aft Payload 
Dry Box 


Lift Handle 


UMBILICAL 


Rudder 


This schematic shows the basic configuration 
for the Wave Glider. Essentially a floating 
truck, the solar-powered Wave Glider is 
equipped with systems for navigation, 
payload control, and satellite communications. 


COURTESY OF LIQUID ROBOTICS 


QRACLE.COM/JAVAMAGAZ1NE /////////////////////////////// SEPTEMBER/OCTOBER 2012 


A Variety of 
Applications 


Scientific/environmental. 

Liquid Robotics’ Wave Gliders 
operating at the air-sea inter¬ 
face can collect atmospheric 
and oceanographic data while also providing real¬ 
time telemetry to undersea sensors. 
Commercial/industrial. Wave Gliders can support 
all phases of offshore energy projects, from explora¬ 
tion to production to long-term monitoring. 
Government/defense. Wave Gliders can be used in 
a wide variety of applications, from port and harbor 
security to persistent surveillance and real-time 
subsea-to-air communications. 



sophisticated applications 
for advanced navigation and 
swarming," he explains. 

"Java gives us greater 
flexibility." 

Gosling is also developing 
desktop visualization soft¬ 
ware to help customers see 
what the robots are doing. He 
uses JDK 7 with components 
from the Swing GUI widget 
toolkit and the NASA World 
Wind map ping comp onent . 

Part of the Java Foundation 
Classes, Swing provides an 
API for creating flexible GUIs. World 
Wind is an open source map inter¬ 
face developed by NASA and the open 
source community for use on personal 
computers, similarto Google Earth. 
The program overlays NASA and U.S. 
Geological Survey satellite imagery, 
aerial photography, and topographic 
maps to enable customers to follow 
their Wave Gliders as they wander 
through the world's oceans. 

"This new interface will include 
readouts from the various instru¬ 
ments so you can toggle back and forth 
through time to re-create the history 
of each mission," Gosling explains. 

"We are designing it so you can inte¬ 
grate telemetry data from multiple 
craft to see the tracks of other ships in 
the neighborhood. If you have to pass 
through a shipping lane, you can proj¬ 
ect an animated timeline and correct 
your course if necessary." 


The desktop interface will use World 
Wind maps to animate each phase of 
a mission, from planning the course 
to monitoring day-to-day perfor¬ 
mance to reviewing what happened at 
a particular juncture. However, forthe 
most part, the Wave Gliders are self- 
sufficient. "They go from one waypoint 
to another, and so long as nothing 
exceptional happens they just do their 
thing," explains Gosling. "However, 


Gosling presented “Robots and 
Water and Whales, Oh My!” at the 
Bay Area All Java Event in July. 






































every now and then if the craft is 
going through an area of intense 
ocean currents, or there is a ship 
on a collision course, they'll send 
a message to the pilots on their 
iPhones and ask them to intervene 
to set a different course." 

WHY JAVA? 

Gosling likes using Java due to 
its exceptional performance and 
reliability. He says it's great for 
the cloud-based components and 
also ideal for analyzing telemetry 
data, thanks to its ability to handle 
complex data structures. "These 
are not Web applications, so it's 
not about generating HTML code," 
he adds. "It's more about the 
automatic transmission and anal¬ 
ysis of data from remote sources." 

Due to the exorbitant cost of 
satellite communications from 
the open ocean, Gosling contends 
with a problem that has almost 
vanished from every other pro¬ 
gramming domain: extremely lim¬ 
ited bandwidth. Everything sent 
across the satellite link has to be 
tightly encoded and compressed. 

"The physics of our universe 
is driven by the cost of network¬ 
ing," he says. "Data delivery 
between the craft and shore is 
typically through satellite, which 
costs about $1 per kilobyte. We 
can occasionally use cheaper and 
faster networks, but overall, 


Iridium is our main form of com¬ 
munication on the ocean. So, for 
us to generate a terabyte of data 
would cost a billion dollars in net¬ 
work fees." 

This problem is reduced when 
a craft is close to shore or in the 
vicinity of a drilling rig that has 
a wide-area communications 
hub. It's also not a factorif the 
data is not needed immediately, 
because it can be cached onboard 
and downloaded at a future date. 
However, for most data transmis¬ 
sion and analytic functions, econ¬ 
omy is essential. 

Gosling uses JDK 7 for the 
majority of this development 
work, and he is a heavy user of 
NetBeans, a framework for Java 
desktop applications. He is looking 
forward to using JDK 8, the proto¬ 
type reference implementation of 
JavaSE8. Project Lambda is par¬ 
ticularly interesting. 

"The robot is really a platform 
for all types of test and measure¬ 
ment instruments, whether 
analyzing water chemistry or lis¬ 
tening for whales," Gosling sums 
up. "Whatever the instrument, 
it's connected to the onboard 
Computers." </article> 


Based in Santa Barbara, California, 
David Baum writes about innovative 
businesses, emerging technologies, 
and compelling lifestyles. 
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CELEBRATING 10 YEARS 


DUKE'S 

CHOICE 

AWARDS 


This year’s awards include the first-ever Community Choice Award, 
two user groups, and the United Nations’ refugee agency. 


BY PHILIP GILL 

t first glance, the list of this 
year's Duke's Choice Award win¬ 
ners reads like a diverse group of 
unrelated open source projects, busi¬ 
nesses, usergroups, and individuals 
whose only common trait is java. While 
that is certainly true, a closer reading 
of this year's winners of the Duke's 
Choice Awards—the Java community's 
equivalent of the Oscars—tells us not 
just about some of the latest techno¬ 
logical innovations in Java but about 
how the Java community has grown 
and changed overtheyears as well. 

Historically, Duke's Choice Award 
winners were chosen on the basis of 
technical innovation, but this year the 
judges decided to broaden their crite¬ 
ria. In honoring two Java usergroups 
(JUGs)—a first in the Duke's Choice 
Awards' 10-year history—the awards 


DUKE'S CHOICE AWARD 
WINNERS 2012 

(in alphabetical order by 
organization name) 

AgroSense 

Hadoop 

Apache Software Foundation 

JDuchess 
Jelastic, Inc. 

Liquid Robotics 
London Java Community 

MICE 

North Atlantic Treaty Organization 

Parleys.com 
Ram Kashyap 

Student Nokia Developer Group 

Level One Registration Tool 
United Nations High 
Commissioner for Refugees 










































\ JDUCHESS 

Ui “We provide a 
|\\H platform through 
which women 
'■ V can connect with 
ft V each other and 
I 1 :! get involved in 
■| the great Java 
3Pi community.” 

—Regina ten Bruggencate 


drive home the fact that Java remains 
a user-driven, ratherthan vendor- 
driven, phenomenon. 

"This year we had more freedom to 
make decisions," explains John Yeary, 
one of thisyear's judges and the leader 
of the Greenvijle (South Carolina) Java 
Users Group (GreenJUG). "We decided 
as a wholethat a couple ofwinners 
were worthy of awards not just based 
on their technology innovation, but by 
being innovative in their approach to 
making the community better." 

Although the two winning user 
groups don't develop code, Yeary 
explains, they do foster the growth 
and development of those who do. The 
London Java Community (LJC) and its 
users have been active in the OpenJDK, 
the Java Community Process (JCP), 
and other efforts. (LJC representative 
Ben Evans is the subject of an in- 

PHOTOGRAPHS BY TON HENDRIKS, . . . . .... 

JOHN BLYTHE depth interview in this issue—see 
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"JCP_Executive Series: A Conversation 

with Ben Evans." on page 12.) 

Ratherthan focus on a specific geo¬ 
graphic area like most JUGs, JDuchess 
fosters the participation of women 
in the Java community worldwide. 
JDuchess has more than 500 members 
in 60 countries, according to Regina 
ten Bruggencate, who runs the group 
with founder Linda van der Pal. 

"We provide a platform through 
which women can connect with each 
other and get involved in the great Java 
community," says ten Bruggencate. 
"We welcome all women who are 
interested in Java technology, includ¬ 


ing developers, architects, testers, 
business analysts, managers, and oth¬ 
ers. We believe that women have an 
essential role to play in the future of IT 
as it evolves the global economy." 

A HEART AND A SOUL 

While there's no question that Java 
has "a head for business," thisyear's 
winners are using the technology to 
tackle some of the pressing human- 


LONDON JAVA COMMUNITY 

“I personally wanted our 
JUG to become more of a 
community participant. 

I wanted to participate 
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itarian and environmental challenges 
of the day. The United Nations High 
Commissioner for Refugees (UNHCR) 
is on the front lines of crises around 
the world, from civil wars to natural 
disasters. To help facilitate its mission 
of humanitarian relief, the UNHCR has 
developed a light-client Java applica¬ 
tion on the NetBeans platform. 

First deployed this year in the 
Western African republics of Mali and 

PHOTOGRAPH COURTESY OF UNHCR Niger, the Level One registration tool 
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Community Choice: The first - ever community 

■yavAj ii Choice Award goes to the 

NAIUSMIUt MASE Integrated Console 

Environment (MICE) in use at the North Atlantic Treaty 
Organization (NATO). Built in Java on the NetBeans platform, 
MICE provides a high-performance visualization environment 
for conducting air defense and battle-space operations. 

According to Angelo D’Agnano, a software architect at the 
NATO Programming Centre, MICE updates NATO’s Multi- 
AEGIS Site Emulator (MASE) console, which was built in the 
1990s using C/C++ and Motif. Java was chosen because it 
is already used in many components of NATO’s Air Command 
and Control System (ACCS). 

MICE relies on two external libraries: LuciadMap, a set 
of software components for high-performance visualiza¬ 
tion for the system’s geographic information display, and the 
NetBeans platform for the application framework. “While the 
usage of the LuciadMap has helped to achieve the required 
real-time performance for the display,” D’Agnano writes in 
a post in the NetBeans Zone of the DZone developer site, “the 

NetBeans RCP [rich client platform] allowed the development 
team to save significant time; the ready to use solutions, 
design patterns and guidelines helped to achieve a solid and 
consistent design of the application.” 

In May 2012, the NATO Programming Centre delivered the 
first operational version of the MICE console to 60 locations 
in 20 countries. 



enables the UNHCR 
to collect informa¬ 
tion on the number 
of refugees and to 
plan the distribution 
of water, food, hous¬ 
ing, healthcare, and 
other aid in the field, 
and combines those 
capabilities with 
geocoding informa¬ 
tion from various 
sources. This enables 
the UNHCR to deliver 
the appropriate 
kind and amount of 
assistance where it is 
needed. "The appli¬ 
cation decreases the 
time needed to give 
the first assistance 
to refugees and 
planning to amelio¬ 
rate the response," 
explains Stanyslas 
Matayo, team 
leader on the Level 
One development 
project. 

"Level One registration helps to solve 
the issues of registering and locating 
families and friends," says GreenJUG's 
Yeary. "The impact on humanity from 
this software is clear. There is no service 
higherthan helpingyourfellow man. It 
helps me sleep better at night knowing 
that people are out there working on 
projects like these." 


Improving farming methods to 
feed a hungry world is the goal of 
AgroSense, an open source farm infor¬ 
mation management system built 
in Java and the NetBeans platform. 
Lead developerTimon Veenstra says 
AgroSense enables farmers, agri¬ 
businesses, suppliers, and others to 
develop application modules that will 














































—Timon Veenstra 


AGROSENSE 

“AgroSense provides a 
rich client that enables 
farmers to work offline 
when in the field or when 
the connection is bad, 
and full connectivity 
when a broadband 
connection is available.” 


PHOTOGRAPH BY TON HENDRIKS 


easily exchange information through a 
common underlying NetBeans frame¬ 
work. These modules will be sold 
through an online app store, similar 
to Apple's iTunes. Nonprofit modules 
can be provided to the farmers free 
of charge. Precision agriculture sup¬ 
port modules will allow farmers to get 
maximum crops with the least amount 
of fertilize rand chemicals. 

Veenstra says that current rival solu¬ 
tions either "do not communicate 
with the rest of the world" or require 
high-bandwidth internet connections 
not always available in rural areas. 
"AgroSense provides a rich client that 
enables farmers to work offline when 
in the field or when the connection 
is bad, and full connectivity when a 
broadband connection is available." 

Another Duke's Choice Award win¬ 
ner, Liquid Robotics, is an ocean data 
services provider whose Wave Glider 
technology collects information from 
the world's oceans for application in 
government, science, and commercial 
applications. Liquid Robotics boasts 
Java pioneer James Gosling as its chief 
software architect, and is the subject of 
this issue's cover story, "Java atSea," 
on page 17. 

TECHNOLOGY LEADERS 

Not surprisingly, this year's awards also 
show us that Java is at the forefront of 
today's most-important technological 
challenges. Moving existing Java appli¬ 
cations to the cloud can be a daunting 


task, but startup Jelastic. Inc., offers 
the first Java platform as a service 
(PaaS) that enables existingjava appli¬ 
cations to get up and runningin the 
cloud without code changes or lock-in, 
according to Judah Johns, the Palo Alto, 
California, firm's chief evangelist. In 
addition, the Jelastic platform offers 
unlimited scalability, also without 
changes to the existing code. 

"The Jelastic platform is the only 
standards-based Java hosting platform 
and the first to be offered through 
service providers around the globe," 
says Johns. 

Handling big data—extremely large, 
complex data beyond the ability of 
traditional data management tools— 
is a pressing concern for all types of 
organizations. The Apache Software 
Foundation's Hadoop project, written 
in Java, provides a framework for dis¬ 
tributed processing of large data sets 
across clusters of computers, from a 
few servers to thousands of machines. 

"Hadoop permits institutions to 
benefit from much more of the data 
they generate," explains Doug Cutting, 
chairman of the Apache Software 
Foundation and founder of the Hadoop 
project. "With Hadoop they can afford 
to store and analyze data that they 
were previously discarding. Harnessing 
more data lets folks better understand 
and improve their business." 

"Java is the primary language of the 
Hadoop ecosystem," Cutting contin¬ 
ues. "And Hadoop is the de facto stan- 
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dard operating system for big data. 

So, as the big data trend spreads, Java 
spreads too." 

Two other winners are adding 
novel twists to existing technologies. 
E-learning specialist PaHeys.com, 
based in Brugge, Belgium, uses Java 
technologies to bring online classes 
and full IT conferences to desktops, 
laptops, iPads, and Android and 
BlackBerry PlayBook devices. Founder 
and CEO Stephan Janssen says 
Parleys has hosted more than 1,700 
conferences—including Devoxx and 
JavaOne—for more than 800,000 
unique visitors. "Parleys allows users 
to view a presentation on their desk¬ 
top or download it on their device for 
offline enjoyment—whenever and 
wherever they want," says Janssen. 

Finally, this year's student winner, 
Ram Kashyap, has already graced the 
pages of Java Magazine. As the founder 
and president of the Student Nokia 
Develope r gr oup, he was profiled in the 
cover story in the March/April 2012 
issue of Java Magazine, "The Ne w Java 
Developers." Since then, Kashyap has 
maintained a hectic pace, graduating 
from the People's Education Society 
Institute of Technology in Bangalore, 
India, while working on a Java mobile 
startup and training students on 
Java ME. </article> 


Philip Gill is a San Diego, California- 
based writer and editor who has been 
following Java for 20 years. 


JUDGES 
AND PROCESS 


The winners 
of the 10th 
annual Duke’s 
Choice Awards were selected in a three- 
part process. All members of the Java 
community were first invited to submit 
nominations to this year’s judges. In the 
first two rounds, the judges selected 9 
winners from 68 submissions and 
nominated 6 candidates for the first- 
ever Community Choice Award. In the 
final round, Community Choice Award 
nominees were posted on Java.net, and 
all members of the Java community 
were invited to vote for their favorite. 

The winner, the MICE project from the 
NATO Programming Centre, received 41 
percent of the vote. 

This year’s judges were 

Yara Senger, SouJava 

John Yeary, president and founder, 
GreenviHe Java Users Group 

Glen Peterson, Greenville Java Users 
Group member and CTO, PlanBase Inc. 

Martijn Verburg, London Java Community 
(who abstained from the vote electing 
his JUG) 

Michelle Kovac, Java marketing and 
operations 

Arun Gupta, Java evangelist and GlassFish 
community member 

Sharat Chander, Java evangelist team 
manager 

The 10 winners will be honored 
at JavaOne September 30 through 
October 4 in San Francisco, California. 
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MICHAEL KOLLING 


Part 2 

Learning About Object Interaction 
with BlueJ 

Abstraction and modularization in object-oriented programming 



PHOTOGRAPH BY JOHN BLYTHE 


I n the last issue of Java 
Magazine, I gave you a 
quick overview of the BlueJ 
environment and presented 
the tools that it offers for 
teaching programming con¬ 
cepts to beginners. This time, 
we will discuss a small pro¬ 
gramming example to see 
how BlueJ can help us under¬ 
stand some fundamental, 
but often difficult to grasp, 
programming concepts. 

We will again use a practi¬ 
cal programming example, 
which you can download 
and then play along with as 
we go. 

The Clock Example 

The project we will use to 
discuss the interaction of 
objects is a display for a 
digital clock. The display 
shows hours and minutes, 
separated by a colon (see 
Figure 1). For this exercise, 
we will first build a clock with 


a European-style 24-hour 
display. Thus, the display 
shows the time from 00:00 
(midnight) to 23:59 (one 
minute before midnight). 

It turns out, upon closer 
inspection, that building a 
12-hourclockis slightly more 
difficult, so we will leave that 
until the end of this article. 

Abstraction and 
Modularization 

A first idea for many begin¬ 
ning programmers might 
be to implement the whole 
clock display in a single class. 
That is, after all, what classes 
are for: they represent things, 
and a clock is a thing. 

However, here we shall 
approach this problem 
slightly differently. We will 
see whether we can iden¬ 
tify subcomponents in the 
problem that we could turn 
into separate classes. The 
reason is complexity. As we 


progress in our programming 
practice, the programs we 
build will get more and more 
complex. Trivial tasks that we 
encounter as initial exercises 
can be solved as a single 
problem. You can look atthe 
complete task and devise a 
solution using a single class. 
For more-complex prob¬ 
lems, that is too simplistic. 

As a problem grows larger, it 
becomes increasingly dif¬ 
ficult to keep track of all 
details atthe same time. 

The solution we use to deal 
with the complexity problem 
is abstraction. We divide the 
problem into subproblems 
and divide those again into 
more subproblems, and so 
on, until the individual prob¬ 
lems are small enough to be 
easy to deal with. Once we 
solve one of the subproblems, 
we do not think about the 
details of that part anymore, 
but we treat the solution as a 


11:03 


Figure 1 

single building block for our 
next problem. This technique 
is sometimes referred to as 
divide and conquer. 

Let's discuss this with an 
example. Imagine engineers 
in a car company designing a 
new car. One engineer might 
think about the parts of the 
car, such as the shape of 
the outer body, the size and 
location of the engine, the 
number and size of the seats 
in the passenger area, the 
exact spacing of the wheels, 
and so on. Another engineer, 
on the other hand, whose job 
is to design the engine (well, 
that's a whole team of engi¬ 
neers in reality, but we can 
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simplify a bit here for the sake of 
the example), thinks of the many 
parts of an engine: the cylinders, 
the injection mechanism, the 
carburetor, the electronics, and so 
on. She will think of the engine not 
as a single entity, but as a complex 
work of many parts. One of these 
parts might be a spark plug. 

Then there is an engineer 
(maybe he works in a different 
company) who designs the spark 
plugs. He will think of the spark 
plug as a complex artifact of many 
parts. He might have done com¬ 
plex studies to determine exactly 
what kind of metal to use for the 
contacts or what kind of material 
and production process to use for 
the insulation. 

The same is true for many 
other parts. A designer at the 
highest level will regard a wheel 
as a single part. Another engineer 
much further down the chain 
might spend her days thinking 
about the chemical composition 
to produce the right materials 
for making the tires. For the tire 
engineer, the tire is a complex 
thing. The car company will just 
buy the tire from the tire com¬ 
pany and then view it as a single 
entity. This is abstraction. 

The engineer in the car com¬ 
pany abstracts from the details of 
the tire manufacture to be able to 
concentrate on the details of the 


construction of, say, the wheel. 

The designer designing the body 
shape of the car abstracts from the 
technical details of the wheels and 
the engine to concentrate on the 
design of the body (he will just be 
interested in the size of the engine 
and the wheels). 

The same is true for every other 
component. While someone might 
be concerned with designing the 
interior passenger space, someone 
else might work on developing the 
fabric that will eventually be used 
to cover the seats. 

The point is, if viewed in enough 
detail, a car consists of so many 
parts that it is impossible for a 
single person to know every detail 
about every part at the same time. 
If that were necessary, no car could 
ever be built. 

The reason why cars are built 
successfully is that the engineers 
use modularization and abstrac¬ 
tion. They divide the car into inde¬ 
pendent modules (wheel, engine, 
gearbox, seat, steering wheel, and 
so on) and get separate people to 
work on separate modules inde¬ 
pendently. When a module is built, 
they use abstraction. They view 
that module as a single compo¬ 
nent that is used to build more- 
complex components. 

Modularization and abstrac¬ 
tion thus complement each other. 
Modularization is the process of 
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dividing large things (problems) 
into smaller parts, while abstrac¬ 
tion is the ability to ignore details 
to focus on the bigger picture. 

Modularization and Abstraction 
in Software 

Modularization and abstraction 
are also used in software develop¬ 
ment. To maintain an overview in 
complex programs, we try to iden¬ 
tify subcomponents that we can 
program as independent entities. 
Then we try to use those subcom¬ 
ponents as if they were simple 
parts without being concerned 
about their inner complexities. 

In object-oriented program¬ 
ming, these components and 
subcomponents are objects. If we 
were trying to construct a car in 
software using 
an object- 
oriented lan¬ 
guage, we 
would try to 
do what the 
car engineers 
do. Instead of 
implement¬ 
ing the car in a 
single, mono¬ 
lithic object, 
we would first 
construct 
separate 
objects for an 
engine, gear¬ 


box, wheel, seat, and so on, and 
then assemble the car object from 
those smaller objects. 

Identifying what kinds of objects 
(and with these, classes) you 
should have in a software system 
for any given problem is not always 
easy. In this article, I will show you 
how Blue] can help you build, test, 
and experiment with these kinds 
of components. 

Now, back to our digital clock. 

Examining the Project 

Open the clock-display project, 
which you downloaded, in Blue], 
Initially, you will see a very simple 
class diagram (see Figure 2). We 
can see that our project consists of 
two classes named NumberDisplay 
and ClockDisplay. 



o 

o 


o 

< 


< 

5 







f 




lava 

.net 


\ 

blog 

s._ ) 



Figure 2 


29 
























































//new to java / 



Figure 3 


NumberDisplay is a class that 
represents a single, two-digit dis¬ 
play of a number (see Figure 3). 
We will see that we can use it to 
build our clock display. In fact, 
we can use two instances of the 
number display: one for the hours 
and one forthe minutes. This 
way, we are breaking down our 
problem of building a clock dis¬ 
play into smaller, easier-to-solve 
problems. 

We first build a class for a two- 
digit numberdisplay, and then we 
build the clock display by taking 
two number displays (one forthe 
hours and one forthe minutes) 
and sticking them together. Each 
of the subproblems is easierto 
solve than the whole. 

The NumberDisplay class rep¬ 
resents objects that can store a 
number value up to a given limit. 

It can be incremented, and when 
the value reaches that limit, it rolls 
around back to zero. We will use 
one of these objects with a limit 


of 60 forthe minutes and another 
one with a limit of24forthe hours. 

In BlueJ, we can inspect the 
object in two different ways: we 
can read the source code, or we 
can experiment with the object by 
invoking its methods. Let's start 
with the latter. 

Create an instance of the class 
NumberDisplay by right-clicking 
the NumberDisplay class in your 
diagram and selecting the first 
entry in the menu, which is titled 
new NumberDisplay(int roll 
OverLimit) (see Figure 4). By 
usingthis menu command, you 
are invoking the class's construc¬ 
tor to create an object. 

A dialog box will pop up and 
prompt you to enter a name for 
the instance and a value forthe 
constructor parameter. Here we 
can specify the limit at which we 
want the display to roll over. Let's 
leave the instance name as it is 
suggested, and use 60 for the 
parameter. Once you click OK, a 
NumberDisplay object will appear 
on the object bench (as shown in 
Figure 2). 

We can now experiment with the 
NumberDisplay by right-clicking 
the object and trying out its meth¬ 
ods (see Figure 5). 

We can see that the object has 
four methods. Try them out by 
selecting each one of them. You 
will see that they do the following: 
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■ setValue(int replacementValue) 
lets you specify a value for this 
display. 

■ getValue() returns the current 
value. 

■ getDisplayValue() returns the 
same value (as a String), padded 
with a leading zero to ensure 
that the result is always a two- 
digit number (for example, 

"04" instead of "4"). 

■ increment) increments the 
value by one. 

Another way to experiment 
with the NumberDisplay object is 
to open the object inspector by 
using the Inspect function from 
the object's menu (see Figure 6). 

Here, we can see that the 
NumberDisplay object holds two 
fields: one forthe current value 
and one for its limit. Leave the 
object inspector open, and call 
some of the object's methods 
again. Now you can seethe value 
change and observe the effects 
of the methods. An interesting 
thing to try is to call the incre¬ 
ment method when the value is 
just below the limit. Try it out! 

Another, more traditional way 
to inspect a class is to read its 
source code. Open the source 
code forthe NumberDisplay class 
(by double-clickingthe class 
icon) and read through it. You will 
see how each of the four meth¬ 
ods was implemented. 


Examining ClockDisplay 

Through experimentation with the 
NumberDisplay object, we can get a 
feeling for the behavior and func¬ 
tionality of that object. Now we will 
look at how the ClockDisplay class 
uses two NumberDisplay objects to 
create a clock display. 

Let's start again by creating an 
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object and experimenting with its 
methods: 

■ Create an object of class 
ClockDisplay by right-clicking the 
class and selecting its construc¬ 
tor. You will see that there are two 
constructors—one with param¬ 
eters and one without. Try both. 

■ Right-click the ClockDisplay 
object on the object bench and 
try out its methods. You will see 
that there are three: getTime, 
setTime, and timeTick. 

■ Open the object inspector for 
the ClockDisplay object (see 
Figure 7) by choosing Inspect 
from the menu, and observe its 
fields while you call its methods. 
If you do this, you will observe a 

number of things: 

■ The ClockDisplay object has two 
fields of type NumberDisplay, 
named hours and minutes, for 
storing its time. 

■ The displaystring field in the 
ClockDisplay object shows the 
current time of the clock. We use 
this in our project to simulate 
the display ofourclock. In a real 
clock, this is the time that would 
be shown on its display. 

■ The timeTick method does not 
seem to do anything. 

The last point, the lack of action 
when we call the timeTick method, 
has its roots in a simple fact: the 
project implementation is not fin¬ 
ished. In a real clock, the timeTick 


method would be called regularly 
(once a minute) by the clock timer 
to advance the clock. We now want 
to implement this behavior. 

Inspecting the Source Code 

Let's start by inspecting the 
ClockDisplay source code. Open 
its editor by double-clicking the 
ClockDisplay class icon. 

Looking through the code, we 
can observe the following interest¬ 
ing facts. Three fields are declared, 
two of type NumberDisplay and one 
of type String: 

I private NumberDisplay hours; 
private NumberDisplay minutes; 
private String displaystring; 

The first two hold the 
NumberDisplay objects for the 
hours and minutes, and the last 
represents the current display of 
the clock. The class's constructor 
initializes the three fields: 

public ClockDisplayO 

{ 

hours = new NumberDisplay(24); 
minutes = new NumberDisplay(60); 
updateDisplayO; 

} 

Examine the source code of 
the other methods to familiarize 
yourself with how they work. You 
will seethattheirimplementation 
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is not very complex. 

You will also see that 
the method timeTick is 
empty, explaining why 
it does not yet work. 

Wewill nowimplement 
this method. 

The purpose of the 
timeTick method is to 
advance the clock by 
one minute. We can achieve this 
by adding the following line of 
code to its body: 

I minutes.incrementO; 

This is almost all that's 
required, except for one thing: we 
have to deal with the case where 
the hours are also incremented 
(for example, the time advances 
from 03:59 to 04:00). We know 
that this should happen when the 
minutes roll over to zero, so we 
can add the following: 

I if(minutes.getValue() == 0) { 
hours.increment(); 

} 

And after doing this increment, 
we also have to update the display 
value: 

I updateDisplayO; 

This is the whole implemen¬ 
tation. After adding this to your 


class, yourtimeTick method should 
look like the one shown in Listing 1. 

Do It Yourself 

Now try it out yourself. Type the 
code as we have shown it here, 
and compile the class (clickthe 
Compile button either in the editor 
window orin the main window). 

If you get any errors, carefully 
inspect yourcode and fix them. 

Now create a ClockDisplay object 
again, open its object inspector, 
and experiment with its methods. 
In particular, try the newly imple¬ 
mented timeTick method. You will 
see that it should work. Try it also 
at a point where the hour changes 
and make sure that works as well. 

And Then Do More... 

I have shown you howto examine 
an existing project with Blue] and 
how to make a small improve¬ 
ment. As a programming exercise, 
you can now try several further 
improvements, for example: 

■ Display a warning when a user 







































//new to java / 


tries to set the time to an invalid 
value. 

■ Add seconds to the clock 
display. 

■ Modify the clock to show a U.S.- 
style 12-hour display (04:23 p.m.) 
instead of the European-style 
24-hourversion (16:23). 

Each of these tasks makes a nice 
little programming exercise for 
beginners who know the basics 
and want to practice their pro¬ 
gramming skills. 

Conclusion 

Today, I have presented a small 
programming example that 
started with examining a given 
body of code, progressed to gain¬ 
ing an understanding of exist¬ 
ing functionality, and finished by 
extending the project with new 
functionality. We can clearly see 
now how Blue] helps in the learn¬ 
ing of fundamental concepts. 

Forteachers and learners, sev¬ 
eral aspects of the Blue] environ¬ 
ment are crucial to the process of 
learning: 

■ We can easily see the classes 
involved in the project and their 
relationships. 

■ We can examine any class 
by interactively creating an 
instance of the class and call¬ 
ing its methods. This gives us 
a good understanding of the 
behavior of individual objects. 


LISTING 1 


!** 

* This method should get called once every minute - it makes 

* the clock display go one minute forward. 

*/ 

public void timeTickQ 

{ 

minutes.incrementO; 

if(minutes.getValue() ==0){ //it just rolled over! 
hours.increment(); 

} 

updateDisplayO; 

} 


Download all listings in this issue as text 


■ We can look into objects using 
the object inspector. 

■ We can easily test and experi¬ 
ment using the object bench. 

■ We can concentrate on the 
object structure and logic of 
the program first without the 
distraction of a GUI or a main 
method. This teaches good 
object-oriented principles 
before tackling tedious detail. 
(Of course, GUIs and main 
methods can be added as well.) 
If you are a teacher, or some¬ 
one who wants to teach someone 
object-oriented programming, 
you probably get the idea. Blue] 
offers a unique toolset that is 
much better suited for learning 
the fundamentals of program¬ 
ming than big, professional envi¬ 


ronments, such as NetBeans or 
Eclipse. It has just the right kind 
and right amount of tool support 
needed for programmers in their 
first year, and developers can then 
graduate from Blue] to the profes¬ 
sional environments once they 
have developed a good mental 
model of object orientation. 

So far, I have just shown the 
basics of the Blue] tools. In the next 
episode, we will look at specialized 
support fortesting. </article> 
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Part 2 

Introduction to Web Service Security 
from Server to Client 

Handle transport security using SSL to increase the security of Web services. 


PHOTOGRAPH BY 

ALLEN MCINNIS/GETTY IMAGES 


I n Part 1 of this three-part 
series, I showed you how 
to secure a Web service effi¬ 
ciently both on the server 
and on the client using 
Metro, GlassFish, and the 
NetBeans IDE. 

Nowin Part 2, we will 
see in detail howto use 
NetBeanstools and 
GlassFish default digi¬ 
tal certificates to config¬ 
ure the transport security 
mechanism to protect the 
AuctionApp application 
during transport by using 
Secure Sockets Layer (SSL) 
for authentication. The goal 
of this article is to show how 
easy it is to add transport- 
layer security to protect the 
data transiting between the 
client and the server using 
SSL via the secure HTTP 
transport, HTTPS. 

Note: Th e co m p I ete so u rce 
code for the application 


designed in this article can 
be downloaded here. 

What Is the Transport 
Security Mechanism? 

Transport security is a 
mechanism for secur¬ 
ing data that is circulating 
between a point A and a 
point B. Often used with 
SSL, this mechanism can 
cover several aspects of data 
confidentiality, and it allows 
the server and the client 
to convert a common data 
encryption algorithm using a 
certificate exchange. 

Prerequisites 

Download the following 
software, which was used 
to develop the application 
described in this article: 

■ NetBeans IDE 7.2 (avail¬ 
able for download here) 

■ GlassFish 3.1.2.2 (available 
for download here) 


■ Metro 1.3 or higher 
(included in NetBeans) 
Note: This article was 

tested using the latest ver¬ 
sion of the NetBeans IDE 
(version 7.2, at the time this 
article was written). 

Overview of Adding 
Transport Security to the 
Web Service 

What we are going to do is 
secure the bytes of data that 
are transmitted or received 
between the client and the 
server over an SSL-protected 
session. 

We will perform the follow¬ 
ing tasks: 

■ Secure the Web service by 
addingthe transport secu¬ 
rity mechanism (SSL) and 
configuring the service to 
use HTTPS 

■ Create and configure a new 
client that references the 
Web service by specifying 


the secure Web Services 
Description Language 
(WSDL) file 

■ Test the secure Web service 
Note: The application we 
are going to secure is an 
online auction place (like 
eBay) that we created in a 
previous series of articles 
("Introduction to RESTf ul 
Web Services"). Sellers post 
their items in listings, and 
buyers bid on the items. A 
seller can post one or many 
items, and a buyer can bid on 
one or many items. 

Specifically, we are going 
to limit access to the Java 
API for XML Web Services 
(JAX-WS) Web service that 
extrapolates the amount of 
a bid. 

Add T ra nsport Secu rity to 
the Web Service 

Let's add transport security 
to secure the Web service, 
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in only a few minutes, using the 
NetBeans IDE. 

1. Add a security mecha¬ 
nism called Transport 
with Symmetric Key to the 
AuctionApp application: 

a. Open the AuctionApp project 
in NetBeans IDE 7.2 or higher. 

b. Expand the Web Service 
node of the AuctionApp 
project and right-click the 
AuctionAppSOAPws node; 
then select Edit Web Service 
Attributes. 


c. Under the Quality Of Service 
tab, expand the AuctionApp- 
SOAPwsPortBinding section. 
(See Figure 1.) 

d. Make sure the Reliable 
Messaging Delivery option is 
deselected. 

e. Select Secure Service and 
then select Transport Security 
(SSL) from the Security 
Mechanism list. 

f. Click Configure and select 
the Require Client Certificate 
option. 



Figure 1 
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g. Select Use Development 
Defaults. 

h. Click OK. 

At this point, NetBeans cre¬ 
ates a new Web Services 
Interoperability Technologies 
(WSIT) configuration that 
contains the security ele¬ 
ments within the wsp:Policy 
tags of the wsit-com 
. bon bhel.oracle.auctionApp 
.AuctionAppSOAPws.xml file. 
The file is located in the Web 
Pages/WEB-INF node of the 
AuctionApp project. 

2. Configure the service to use 
HTTPS: 

To be sure the application 
uses SSL, we are going to 
specify the security require¬ 
ments, such as the URL pat¬ 
tern to be protected and the 
Transport Guarantee option 
in the deployment descriptor 
file (Web.xml). 


a. Expand the Web Pages | 

WEB-INF node of the 
AuctionApp project and 
double-click the Web.xml file. 

b. From the Security tab, click 
Add Security Constraint to 
create specific constraints for 
AuctionAppSOAPws. 

c. For Display Name, type a 
name such as SSL transport 
for AuctionAppSOAPws. 

d. From the Web Resource 
Collection, click Add; then 
type Secure Area in the 
Resource Name field, as 
shown in Figure 2. 

e. Type /AuctionAppSOAPws//* 
in the URL Pattern(s) field. 

f. Select the Selected HTTP 
Methods option and 
select the GET and POST 
checkboxes. 

g. Click OK. 

h. Make sure the Enable 
Authentication Constraint 
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option is deselected, as shown 

in Figure3. 

i. Select the Enable User 
Data Constraint option if it 
is not selected and make 
sure CONFIDENTIAL is 

chosen from the Transport 
Guarantee list. 

NetBeans generates the 
appropriate configuration in 
the deployment descriptor. 

j. Click the Source tab to see all 
the details. 

3. Deploy and test the Web ser¬ 
vice application: 

a. Right-click the AuctionApp 
node and choose Deploy. 

b. Open your browser and type 
the resource URL https:// 
local host:8181/AuctionApp/ 
AuctionAppSOAPws?wsd I . 

The server presents its certifi¬ 
cate, as shown in Figure4. 

c. Accept the certificate. 

The WSDL file for the applica¬ 
tion is displayed. 

Create and Configure a New 
Web Client 

In this section, we are going to cre¬ 
ate and secure a new Web service 
client that references the Web 
service that we just secured. To 
do this, we will create the client 
application. 

We will use the Web Service 
Client wizard provided by 
NetBeans IDE 7.2 to generate the 


code and everything we need for 
looking up a Web service. 

Let's code this application in five 
minutes. 

1. Generate the initial NetBeans 
project: 

a. From the File menu, choose 

New Project. 

b. From Categories, select java 
Web. 

c. From Projects, select Web 

Application. 

d. Click Next. 

e. Type 

WebServiceClientSecureSSL 
for the project name and click 

Next. 

f. Make sure the server is speci¬ 
fied as GlassFish Server (or 
similar wording). 

g. Click Finish. 

2. Create the Seller entity: 

a. Right-click the 
WebServiceClientSecureSSL 
project and select New; then 
select Entity class. 

b. Type Seller in the Class Name 
field, type com.bonbhel.oracle 
.WebServiceClientSecureSSL 
in the Package field, and 
click Next. 

c. In the Provider and Database 
screen, select EclipseLink 
(JPA 2.0) (default) from the 
Persistence Provider list, as 
shown in Figure 5. 

d. From the Data Source list, 
select jdbc/sample, which is 
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the datasource provided by 
NetBeans 

e. Click Finish. 

3. Perform actions similar to 
Step 2 to create the Item and 
Bid entities. 

Now we a re goi ng to add 
properties to the entities 
using the NetBeans wizard. 

4. Open the Seller.java file, 
right-click anywhere in the 
code, and select Insert code. 

5. From the Generate wizard, 
select Add property, as shown 
in Figure 6, and add the seller 
properties (String lastName, 
StringfirstName, and String 
email). 

6 . Open the Item.java file and 
add the item properties 
(String title, String description, 
Double initia I Price, and Seller 
seller). 

7. To define the entity relation¬ 
ship, click the NetBeans 
warning lightbulb and 
select Create bidirectional 
ManyToOne relationship, as 
shown in Figure7. 

This action creates a list of 
items in the Seller entity. 

8 . Open the Bid.java file and add 
the item properties (String 
bidderName, Double amount, 
and Item item). 

9. To define the entity relation¬ 
ship, click the NetBeans 
warning and select Create 


bidirectional ManyToOne 
relationship. 

10. Generate the Getter and 
Setter, respectively, for the 
list of items and bids created 
in the Seller and item entities 
by right-clicking anywhere in 
the code and selecting Insert 
code. 

11. From the Generate wizard, 
select Getter and Setter, as 

shown in Figure 8. 

At this point, your Seller.java 
file will look like Listing 1. 

12. Create the JavaServer Faces 
(JSF) pages: 

The client implementation 
we are going to build consists 
of JSF pages based on the 
entities just created. 

a. Right-click the 
AuctionAppWebServiceClient 
project and select New; then 
select JSF Pages from Entity 
Classes, click Add all, and 
click Next. 

b. For Session Bean Package, 

type a name such as 
com.bonbhel.oracle 
.webServiceClientSecureSSL 
.facade and for JSF Classes 
Package, type a name such as 
com.bonbhel.oracle 
.webServiceClientSecureSSL 
.controller. 

c. For Folder Name, type a 
name such as jsfClient. 

d. Click Finish. 
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13. Create the Web 
service client: 

We are going 
to use the Web 
Service Client wiz¬ 
ard to create the 
Web service client. 
We will assume 
that the JAX-WS 
Web service is an 
external service 
that resides in the 
application tier 
over the network. 
So, we will use 
the URLto the 
JAX-WS Web ser¬ 
vice WSDLfile. 

a. Make sure the 
AuctionApp proj¬ 
ect is up and 
running. If itis 
not, right-click 
the AuctionApp 
node and choose 
Deploy. 

b. Right-click the 

WebService¬ 

ClientSecureSSL 

node and choose 
New; then select 

Web Service 
Client. 

c. In the New Web 
Service Client 

wizard, specify 
the URLto the 
Web service WSDL 
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private Long id; 
protected String title; 
protected String description; 
protected Double initialPrice; 
protected Seller seller; 

9 Create unidirectional OneToOne relationship 
9 Create bidirectional OneToOne relationship... 
9 Create unidirectional ManyToOne relationship 


? Create bidirectional ManyToOne relationship... 


public void setId(Long id) { 
this. id = id; 

> 

Figure 7 


©ManyToOne 

protected Seller seller; 

Generate 


public Long getld() 
return id; 

> 


Constructor... 

Logger... 

Getter... 


Setter... 


public void setId(Long i 
this. id = id; 

} 


Getter and Setter... 


Delegate Method... 
Override Method... 
Add Property... 


©Override 

public int hashCode() { 
int hash = 0; 

hash += (id != null ? id.hashCode () 
return hash; 


= 0 ) 


Figure 8 























































//new to java / 


Q New Web Service Client 
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Local File: 

□ W5DL URL: 

PE Registered: 
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Browse. 


Specify a pacfcage name where tine dent java artifacts will be generated: 

Preset: WebSerwteeOten tSecueSSL 

Package: 

□ Oefierate Dispatch code 


file using the fully qualified 
host name, for example, 
https://<you r-ful ly-q ua lified - 
hostname>:8181/AuctionApp/ 
AuctionAppSOAPws?wsdl, as 
shown in Figure 9. 

d. Accept all other default set¬ 
tings. The package name will 
be taken from the WSDLfile. 

e. Click Finish. 

14. Add the extrapolateAmount 

Bid operation provided by the 
JAX-WS Web service to the 
client classes: 

a. Open the Source 
Packages node of the 
WebServiceClientSecureSSL 
project and double-click the 
BidController.java file located 
in the controller package 


com.bonbhel.oracle.auction 

AppWebServiceClient 

.controller. 

b. Put your cursor anywhere 
inside the source editor. 

c. Expand the Web Service 
References node of the 
WebServiceClientSecureSSL 
project and drag the 

extrapolateAmountBid node 
inside the source editor. 

The extrapolateAmountBid() 
method appears at the end of 
the BidController class code, 
as shown in Listing 2. 

Note: Alternatively, you can 
right-click anywhere in the 
source editor and choose 
Insert Code, then select Call 
Web Service Operation and 
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LISTING 2 / LISTING 3 



@Entity 

public class Seller implements Serializable { 
@OneToMany(mappedBy = "seller") 
private List<Item> items; 
private static final longserialVersionUID = 1L; 

@Id 

@GeneratedValue(strategy = GenerationType.AUTO) 

private Long id; 

protected StringfirstName; 

protected String lastName; 

protected String email; 

public List<Item> getltemsQ { 
return items; 

} 

public void setItems(List<Item> items) { 
this.items = items; 

} 

Download all listings in this issue as text 


click the extra polateAmount¬ 
Bid operation in the Select 
Operation to Invoke dialog 
box. 

15. We need to add some 
application logic in the 
BidController class in order 
to extrapolate the amount 
of the bid (by factor, which is 
100) when the user edits or 
views the bid entry. So call the 
extra polateAmountBid opera¬ 
tion to extrapolate the bid: 
a. Open the BidController.java 
file in the source editor. 


b. Modify the public String 
prepareViewQ method as 

shown in Listing 3. 

At this point, the secured Web 
service client is regenerated and 
references the secured Web ser¬ 
vices WSDLfile. 

Test the Secured Web Service 

Now it's ti me to test the service. 
We will invoke the secured Web 
service from the client application. 

In this section, we are going to 
use the secured Web client applica¬ 
tion we created in the previous sec- 
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tion (WebServiceClientSecureSSL) 
and the unsecured Web client 
(AuctionAppWebServiceClient) to 
perform the following tasks: 

■ Try to invoke the secured Web 
service from the unsecured cli¬ 
ent application included in the 
project 

■ Use the secure client to invoke 
the secured Web service 

1. Try to invoke the secured Web 
service from the unsecured 
client to display the extrapo¬ 
lated amount of a bid: 

a. Make sure the AuctionApp 
project is up and running. 

If it is not, right-click the 
AuctionApp node and choose 
Deploy. 
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Figure 10 
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Figure 11 


b. Open the Web 
Service node of the 
AuctionAppWebServiceClient 
project and right-click the 

AuctionAppSOAPws node; 
then select Refresh. 

c. From the Confirm Client 
Refresh wizard, make sure 
Also replace local wsdl file 
with original wsdl located at: 
is selected; then click Yes. 

d. Right-click the 
AuctionAppWebServiceClient 
project and choose Clean and 
Build. 

e. Right-click the 
AuctionAppWebServiceClient 

project again and choose Run. 
The list of all entries is dis¬ 
played, as shown in Figure 10. 

f. Click the Show all Bid Items 
linkto display the list of bid 
entries, as shown in Figure 11. 

g. Click the View link for the 
bidder named Fall to see the 
newly extrapolated amount 
of the Fali bid, as shown in 
Figure 12. 

As you can see, the amount 
of the bid changed from 10.0 
toO.O.This means thatthe 
client failed to call the secured 
Web service. 

2. Use the secured Web client 
(WebServiceClientSecureSSL) 
to invoke the secured Web 
service to display the extrapo¬ 
lated amount of the bid: 
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Figure 12 

a. Make sure AuctionApp is up 
and running. If it is not, right- 
click the AuctionApp node 
and choose Deploy. 

b. Right-click the 
WebServiceClientSecureSSL 
project and choose Clean and 
Build. 

c. Right-click the 

WebServiceClientSecureSSL 

project again and choose 

Run. 

The list of all entries is dis¬ 
played, as shown in Figure 10. 

3. Click the Show all Bid Items 
link to display the list of bid 
entries, as shown in Figure 11. 

4. Click the View link for the 
bidder named Fali to see the 
newly extrapolated amount 
of the Fali bid, as shown in 
Figure 13. 

As you can see, the amount 
of the bid changed from 10.0 
to 1000.0. This means that 
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Figure 13 

the client was able to call the 
secured Web service. 
Excellent! 

Conclusion 

In this article, we have seen how 
easy it is to add transport-layer 
security to an existing application 
using SSL via HTTPS to protect the 
data transiting between the client 
and the server. 

NetBeans and GlassFish make 
adding security for Web services 
easier than ever. 

In the next article in this series, 
Part 3, we will focus on creating 
authorized users for the Web 
service. </article> 

/ LEARN MORE 

• NetBeans Advanced Web Service 

Interogerabilily. manual 

• Metro User Guide 

• GlassFish resources 



















































Looking Ahead to Project Lambda 


Java Language Architect Brian Goetz 
explains the importance of lambda 
expressions, which are coming in 
Java SE 8. BY JANICE). HEISS 

F ew people know as much about 
the Java platform as Brian Goetz, 

Oracle's Java language architect. 

When asked about sources of new 
insights into Java, Java Champion Dick 
Wall remarked, "Talking with Brian 
Goetz is always fascinating." 

Goetz has published more than 80 
articles on such topics as best practices, 
platform internals, and concurrent 
programming, and he is the principal 
author of java Concurrency in Practice, 
a 2006 Jolt Award Finalist and the 
best-selling book at the 2006 JavaOne 
conference. Prior to joining Sun 
Microsystems in August 2006, he was 
a software consultant who, in addition 
to writing about Java technology, spoke 
frequently at conferences and gave 
presentations on threading, the Java 
programming language memory model, 
garbage collection, Java technology 
performance myths, and other topics. 
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Java Language 
Architect Brian Goetz 
says a productive 
language is often one 
where the obvious 
solution is also a good 
solution. 


Java Magazine: What wi 11 La m bd a offe r 
the "average" Java developer? Can you 
give us specific types of cases where 
developers will be able to do some¬ 
thing because of Lambda that they 
would not otherwise do? 

Goetz: In a trivial sense, since Java is 
already Turing-complete, additional 
language features don't expand the set 
of programs that can be expressed. But 
in practice the story is quite different. 
The set of features offered by a given 
language determines what programs 
can be expressed easily and cleanly. 

And this is important, because devel¬ 
opers are human. A productive lan¬ 
guage is often one where the obvious or 
easy solution is also a good solution— 
because this keeps our natural laziness 
from leading us into harm. 

The average developer's first experi¬ 
ence with lambda expressions is likely 
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lection to be applied to each element: 


to be through the new APIs for manip¬ 
ulating collections. Lambda is not just 
about language features but it is also 
about libraries, and together these 
constitute a significant upgrade to the 
programming model. 

Adding lambda expressions—known 
also as closures —to the Java lan¬ 
guage provides developers, especially 
API designers, with a sharper tool for 
abstracting over behavior. While Java 
developers already have some tools 
with which to do so, the compactness 
of lambda expressions will definitely 
change the game in terms of what 
code is natural to write. 

Take collections. The way to enumer¬ 
ate the elements of a collection is to 
ask for an iterator, and pull elements 
from the iterator, a task that is auto¬ 
mated by thefor-each loop: 

for (Person p: people) { 

//do stuff with p 

I } 

This is an idiom called external itera¬ 
tion. It is perfectly straightforward, but 
it has a lot of accidental characteris¬ 
tics that have nothing to do with the 
task of operating on each element of a 
collection—it is inherently sequential, 
elements must be processed in the 
orderin which they appearin the col¬ 
lection, and the client is responsible 
for the mechanics of iteration. On the 
other hand, internal iteration lets the 
client pass some behaviorto the col¬ 


I people.forEach(p -> {/* do stuff with p 
*/ }); 

While this may seem no different, 
some very big things have changed — 
the library is nowin control of the 
mechanics of the computation. While 
the client still specifies the what, it 
no longer specifies the how—and 
this is a good thing. Maybe the library 
will use parallelism, or exploit what 
it knows about memory locality to 
process elements in an orderthatis 
more efficient, or any number of other 
techniques for getting to the right 
answer faster. (Whether and when it 
should do these, and how they should 
be specified, are still hard questions, 
but in the internal iteration model 
they are at least possible, whereas in 
the external iteration model they are 
outright impossible.) Since the goal of 
writing libraries is to enable reuse of 
code written by experts, moving more 
details of how into the library opens 
a lot of doors for more expressive and 
performant libraries. 

Java Magazine: How does this change 
the character of libraries? 

Goetz: Lambda expressions enable the 
development of APIs where the library 
can retain control of a computation, 
but allow it to be more easily custom¬ 
ized by the client; in turn, this gener¬ 
ally requires the client to do less work 
to use them effectively. This affects 
































Working on Java SE 8’s 
lambda expressions keeps 
Goetz on the run. 


the APIs that we write, which in turn 
affects the character of the Java code 
that actually gets written. Another way 
to think of this is that having lambda 
expressions in the toolbox enables 
APIs to be more "permeable." External 
iteration provides a rigid demarcation 
between the library behavior and the 
client; the library hands up data one 
element at a time, and the client takes 
it from there. Internal iteration allows 
the client and library to cooperate in a 
more fine-grained way, each providing 
the portions of behavior they are best 
suited to provide. 

For example, take the problem "find 
the groups that have at least one 
employee over 65, and print them in 
increasing order of size." Today, we 
might write this as follows: 


I List<Employee> people = ... 

Set<Group> groups = new HashSet<>(); 



for (Person p: people) { 
if (p.getAgeO >= 65) 
groups. add(p.getGroupO); 

} 

List< Group> sorted = new 
ArrayListo (groups); 
Collections.sort(sorted, new 
Comparator<Group>() { 

public int compare(Group a, Group b) 

{ 

retu rn Integer.com pa re(a .getSizeQ, 
b.getSizeO); 

} 

}); 

for (Group g: sorted) 

System.out.println(g.getName()); 

This is kind of ugly. We have several 
garbage variables here— groups and 
sorted— that exist only to hold inter¬ 
mediate results. The code is very ad 
hoc; small changes to the problem 
statement will have big ripple effects 


on the code. There's a lot of copying of 
data to get it into and out of the inter¬ 
mediate collections. And you have to 
read the data carefully to see what is 
going on. 

Lambda-enabled collection librar¬ 
ies offer a much cleaner way to express 
this computation: 

people.filter(p -> p.getAgeO > 65) 
.map(p -> p.getGroupO) 
.removeDuplicatesO 
.sorted(comparing(g -> g.getSizeQ) 
.forEach(g -> System.out.println(g. 
getNameO); 

There are no garbage variables, and 
you can read the computation from 
top to bottom and see exactly what is 
going on. It is the ability of the library 
to let the user parameterize the com¬ 
putation with little bits of functionality 
that drives this sort of library design, 
which makes things easier (and often 
more efficient) for the user. Moreover, 
small changes to the problem state¬ 
ment are more likely to resultin small 
changes to the code. 

Java Magazine: Which ki nds of Java 
developers will most benefit from 
Lambda? 

Goetz: Everybody will benefit—even¬ 
tually. Library designers will benefit 
by having better tools for designing 
APIs; users will benefit by having richer 
libraries; organizations will benefit by 
having a greater ability to rely on pow¬ 
erful, performant libraries. 
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GAME CHANGER 

The compactness of lambda 
expressions will definitely 
change the game in terms of 
what code is natural to write. 



Java Magazine: Whichkindsofd eve I - 
opers, or developers faced with certain 
situations, will have to make the great¬ 
est adjustments because of Lambda? 
Will Lambda, under certain conditions, 
make life harder for some developers? 
Goetz: Change always has a cost. This 
is not simply a matterof some new 
syntax; there are some new concepts 
here, and developers will have to learn 
them just to be able to read java code, 
even if they do not plan to take advan¬ 
tage of these new features in the code 
they are writing. And there are also 
big additions to the core libraries; 
developers will have to learn these, 
too. But these costs should be more 
than made up for by increases in pro¬ 
ductivity and expressiveness. 

Java Magazine: What does Project 
Lambda have to do with parallelism? 
Goetz: The examples we've given so far 
are simply about structuring libraries 
to enable more expressive, less error- 
prone code, and this is certainly one 
of the key goals. But another key goal 
is lowering the barto exploiting hard¬ 
ware parallelism. While we added the 


fork/join framework in Java SE 7, which 
helps developers write algorithms that 
can run efficiently on a wide range 
of core counts, there is still a big gulf 
between the source code for serial and 
parallel algorithms. If I wrote the code 
for doing the "groups with employees 
over 65" query to run in parallel using 
fork/join, you'd hardly recognize the 
code. It would fill a page and would 
look almost nothing like the sequential 
implementation forthat problem. 

By migrating from an external itera¬ 
tion model to an internal iteration 
model, parallelism is one more thing 
that we can move into the library. The 
above query can be parallelized with a 
small change: 

people.parallel!) 

.filter(p -> p.getAgef) > 65) 

.map(p -> p.getGroupO) 
.removeDuplicates() 
.sorted(comparing(g -> g.getSizeQ) 
.sequential!) 

.forEach(g -> System.out.println(g. 

getName!)); 

All that has changed is the insertion 
ofthe parallel!) and sequential!) calls; 
the filter/map/sort can now happen 
in parallel, and at the end when we 
want to process the elements in order, 
we switch back to serial mode. Now, 
obviously we have to do some work to 
add parallelism to the libraries, but the 
internal iteration model makes this at 
least possible. 



co 


i- 

=) 

o 

co 

< 



f 




java 

.net 




ORACLE.COM/JAVAMAGAZINE /////////////////////////////// SEPTEMBER/OCTOBER 2012 



























Java Magazine: HowdoesLambda 
address the problem of the aging of 
Java libraries? 

Goetz: The Java Collections framework 
was added in Java 1.2, and the core 
abstractions— Set, List, and Map— have 
remained unchanged for almost fif¬ 
teen years. This is because once pub¬ 
lished, we cannot add new functional¬ 
ity to an interface without breaking 
existing implementations. Ironically, 
adding lambda expressions to the Java 
language makes this problem worse. 
Once we have lambda expressions, we 
immediately begin wanting additional 
methods, such as Collection.forEach. 
(Wheneveryou add a language fea¬ 
ture, you put pressure on existing APIs, 
since some of them would likely have 
been written differently had the fea¬ 
ture been available at the time they 
were written.) 

Because adding lambda expres¬ 
sions to Java had the unintended 
consequence of making our aging 
Collections APIs look even older, 
we decided to pair lambda expres¬ 
sions with another feature—default 
methods. This feature allows you to 
compatibly add a new method to an 
interface if the interface provides a 
default implementation—a fallback in 
case classes implementing the inter¬ 
face don't provide one. These default 
methods are fully virtual methods, like 
any other interface method—classes 
can override them or not, as they 
please. This is how we're going to add 


the new methods to exist¬ 
ing APIs to take advantage of 
lambda expressions. 

This feature bears simi¬ 
larities to features from 
other languages, but this is 
a slightly different approach. 

C# has extension methods, 
but its extension methods 
are static, whereas Java's 
default methods are virtual. 

C++ has unrestricted mul¬ 
tiple inheritance. Default 
methods allowfor multiple 
inheritance of behavior 
(Java always had multiple 
inheritance of types), but 
not multiple inheritance of 
state (which is where many problems 
in C++ inheritance come from). Scala 
has traits, but default methods are 
more limited than traits. These differ¬ 
ences are motivated by our goals—our 
primary goal in adding default meth¬ 
ods was interface evolution. 

Java Magazine: Two co ncepts j u m p out 
when I look at examples of the new 
Lambda-enabled collections— laziness 
and streams. What is laziness? What 
are streams? 

Goetz: Laziness has to do with the tim¬ 
ing of when an operation occurs. Take 
the code fragment: 

I bobs = people.filter(p -> 

p.getFirstName().equals("Bob")); 

When does the filtering actually occur? 


There are two choices: All 
the filtering is complete 
on return from the filter() 
method, or the filtering 
happens as we attempt to 
pull elements from bobs. 

The former is termed eager; 
the latter is termed lazy. 

The choice of whether to 
compute eagerly or lazily is 
anotherone of those imple¬ 
mentation flexibility choices 
that libraries acquire under 
an internal iteration model. 

Laziness can be a big 
performance advantage. If 
we were doing the filtering 
eagerly, we'd have to evalu¬ 
ate the predicate on every element of 
the input. But what if we wanted only 
the first result, and the list had a mil¬ 
lion elements? We'd have wasted a lot 
of time. (Laziness also opens the doors 
to calculations on infinite data sets.) 

In order to achieve laziness, the filter() 
method returns not a fully populated 
collection but a stream. A stream is like 
an iterator; you can pull values from it 
until it is empty, but it doesn't do any 
filtering until you actually ask it forthe 
next element. By modeling calculations 
as streams, we can avoid having to stuff 
the data into intermediate collections 
as we do filtering, mapping, and so on 
and instead operate on the values as 
they flow by. This allows queries like 
the ones above to be not only more 
readable but more efficient, too. In the 


IT’S OK TO SLACK 

Laziness can be a 
big performance 

advantage. If we 

were doing the 
filtering eagerly, 
we’d have to 
evaluate the 
predicate on 
every element of 
the input. 
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TAKE CARE 


Careful programmers 

will find that lambda 
expressions can make 
their code clearer, 
cleaner, and easier 
to read; careless 
programmers will no 
doubt use them to 
create code that is even 
more cryptic, poorly 
factored, and confusing. 


sequential example of the "groups with 
employees over 65" query, we don't 
have to populate intermediate col¬ 
lections that are about to be thrown 
out. The parallel version can actually 
be done in a single parallel 
pass, rather than separate 
passes for filtering, mapping, 
and sorting. Laziness is what 
enables these characteristics. 
Java Magazine: What ki nds of 
feedback would you like from 
the Java community about 
Lambda and Java SE 8 in its 
current stage of development? 
What questions would you 
like them to answer, and how 
can they check out the code? 
Goetz: The single most impor¬ 
tant thing that the commu¬ 
nity can do to help is try it out. 
Download binaries and try 
using the new Collections fea¬ 
tures or using lambda expres¬ 
sions in your own code, and 
report your experiences. 

Java Magazine: Somedevelop- 
ers appearto be afraid that lambda 
expressions might be very clever but 
also very difficult to understand and 
maintain by someone who is not the 
author. Can you address this concern? 
Goetz: This is a risk, but it's a risk that 
is present without lambda expressions, 
too. It is possible to write very clear, 
clean, easy-to-read code in Java, and it 
is also possible to write cryptic, poorly 
factored, confusing code. Careful pro¬ 
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grammers will find that lambda expres¬ 
sions can make their code clearer, 
cleaner, and easier to read; careless 
programmers will no doubt use them 
to create code that is even more cryptic, 
poorly factored, and confusing. 

One of the hidden dividends of the 
changes comingin JDK 8 is a gentle 
push away from mutability. In the 
example above, the "old" version did 
everything via mutation—populating 
and modifying collections of intermedi¬ 
ate results. The second version is done 
without any mutation by the client, and 
this ends up being less error-prone. 
This also works better with the hard¬ 
ware trend toward multicore systems. 
Java Magazine: Whatopenqu esti o n s i n 
Lambda still have to be dealt with? 


Goetz: There's still a lot of work left to do 
with the libraries. The examples above 
are illustrative, but we're still working 
on exactly how these featu res wi 11 be 
blended into the libraries. </article> 


Janice J. Heiss is the Java acquisitions 
editor at Oracle and a technology editor at 
Java Magazine. 

/ LEARN MORE 

• Project Lambda 

• Download Lambda binaries 

• JSR 335: Lambda Expressions for the 

lava Programming Language 

• Brian Goetz' blog 
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Part 2 

Inside the Java HotSpot VM 2: 
Statistics for Performance Analysis 

Why benchmarking at the macro level, understanding the distribution shape, and measuring from the 
client’s perspective are critical. 


I n the first article in this 
series, we introduced the 
Java HotSpot VM and some 
of the basic concepts related 
to runtime compilation of 
methods. If you haven't 
already read that article, you 
may want to check it out 
before continuing. 

In this article, we want to 
discuss some of the subtle¬ 
ties that are inherent to 
performance analysis on the 
Java platform. Specifically, we 
wantto look at the handling 
of statistics for observed 
method timings—especially 
microbenchmarks. 

There are many blog posts 
and articles on the internet 
that draw wrong conclusions 
about Java performance, 
because they do not take into 
account the statistical behav¬ 
ior of Java performance num¬ 
bers at the micro level. 


In writing this article, we 
hope to show the difficul¬ 
ties involved in accurate 
microbenchmarking and 
to encourage the reader to 
focus on benchmarking at 
the macro level—that is, at 
the level of whole applica¬ 
tions and application tiers— 
rather than focusing on small 
methods and very short sec¬ 
tions of code. 

Let's start by looking at a 
modified version of the code 
we used in the last article 
(see Listing 1). 

This code is essentially the 
same as the code we used 
last time to show the effect 
of just-in-time (JIT) compila¬ 
tion and inlining on simple 
methods, such as getters and 
setters, but we've added two 
features: 

■ The ability to run with a 

small amount of object 


allocation on each itera¬ 
tion. This will cause gar¬ 
bage collection to eventu¬ 
ally run. 

■ Instrumentation to allow 
us to collect the length of 
each individual iteration. 
In the last article, we just 
calculated the averages and 
didn't worry about what 
the actual timings were for 
each run. However, we need 
a better level of detail to 
fully explore the statistical 
aspects we want 
to investigate. 

We'll use the class 
i n Listing 2 to 
manage the runs. 

Let's look at 
some output for a 
run without allo¬ 
cation on a 2010 
MacBook Pro 
usingjava SE 7u4 
(see Listing 3). 


The calculated average 
for the actual run is 44.9 ns, 
but the 50th percentile is 0, 
which would imply that the 
code took no time at all to 
run. These results seem to 
contradict each other. 

In fact, this effect is caused 
by the Mac OS X timing sub¬ 
system, which records time 
only at the microsecond 
level, which causes System 
.nanoTime() to return results 
that are whole thousands 
of nanoseconds 
(because 1,000 ns 
equals 1 mu). This 
shows how impor¬ 
tant it is to have an 
awareness of the 
hardware and OS 
features that can 
affect the perfor¬ 
mance numbers 
produced on a 
specific platform. 


NOTTHE NORM 


Typical values 
for performance 
metrics obtained 
from a JVM do 
not usually form a 
normal distribution. 
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On other operating systems 
and hardware, the granularity of 
nanoTimeQ is actually nanosec¬ 
onds. From here on, we'll use the 
same hardware and Java Virtual 
Machine (JVM), but we'll run 
under Ubuntu Linux, so we can 
obtain the finer precision we need 
for individual runs. 

The Distribution of Results 

One very important aspect of 
gathering good numbers for per¬ 
formance tuning is to understand 
the distribution of performance- 
sensitive results. In particular, typi¬ 
cal values for performance metrics 
obtained from a JVM do not usu- 
allyform a normal distribution. 

Instead, a performance metric, 
such as the time taken to execute 
a method, is typically composed 


of two parts: the underlying result 
plus some noise introduced by 
the JVM. In general, the amount 
of noise introduced by the JVM is 
always positive, and it might be 
much larger than the value being 
measured. 

This meansthatthe shape ofthe 
distribution is not a normal (also 
called a Gaussian or bell curve) 
distribution, but instead it will 
becloserin shape to a distribu¬ 
tion with an asymmetric, fat tail. 

In overall shape, it will resemble a 
Gamma distribution, as shown in 
Figure 1, but it will have individual 
outlying points at large values. 

In order to see how this occurs, 
let's consider the effect of one 
ofthe most important compo¬ 
nents of the JVM: garbage collec¬ 
tion (GC). As we know, the JVM 
mark-and-sweep 
algorithm causes all 
application threads 
to pause periodi¬ 
cally. This means 
that some instru¬ 
mented methods 
might be running 
when GC begins. 

The results will then 
appearto show 
those runs as being 
much slowerthan 
normal, because the 
measured method is 
paused while GCis 
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LISTING 2 / LISTING 3 


import java.util.UUID; 

import java.util.concurrent.Callable; 

public class GetSetCallerWithAlloc implements Callable<Double> { 

private final int runs; 
private final long[] results; 
private final boolean doAlloc; 

public GetSetCallerWithAlloc(long[] res, boolean alloc) { 
results = res; 
runs = res.length; 
doAlloc = alloc; 

} 

(©Override 
public Double call() { 

ViaGetSet getSet = new ViaGetSet(); 

double sum = O; 

UUID uuid; 

long end, start = System. nanoTime(); 
for (inti = 0;i < runs; i++) { 
getSet.setOne(getSet.getOne() +1); 
sum += getSet.getOne(); 
if (doAlloc) { 

uuid = UUID. randomUUID(); 
sum += uuid.toString().Iength(); 

} 

end = System. nanoTimeQ; 
results[i] = end - stare¬ 
start = end; 

} 

return sum; 

} 

} 


Download all listings in this issue as text 
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running. The effects of GC can be 
quite severe. 

To demonstrate these effects, 
let's look at some results that show 
two runs—one without allocation 
and one with—to show the extent 
of the problem of outlying points. 
To fully illustrate the issue, we'll 
show the time taken to reach cer¬ 
tain percentile levels. To read these 
results, recall that the 99 percent 
level is the duration that 99 per¬ 
cent ofall timings were less than. 

Listing4 is from Ubuntu Linux 
11.04 on a MacBook Pro 2010 with 
JDK7u4and no allocation, and 
Listing 5 is from Ubuntu Linux 
11.04 on a MacBook Pro 2010 with 
JDK7u4and allocation. 

There are several things to 
notice. The first is that even with 
no allocation, there are still a few 
results that are outliers. These 
are caused by 
effects such as 
the action of the 
operating sys¬ 
tem scheduler. 

The most pro¬ 
nounced effect, 
though, is with 
the addition 
of allocation. 
This causes the 
90th percentile 
value to move 
from 23 ns to 
5.00 mu—that 


is two orders of magnitude. The 
introduction of allocation caused 
the effect that we're trying to mea¬ 
sure to get completely swamped. 
Such are the perils of writing 
microbenchmarks on the JVM; 
these really are very specialized 
cases that should be done only by 
experts who are used to working 
with the JVM at a low level. 

Ratherthan tryingto benchmark 
extremely small sections of code 
and deduce upward, most devel¬ 
opers should focus on larger-scale 
observables that are directly rel¬ 
evant to an application's business 
goals, such as overall throughput 
or end-to-end response time. 

Statistical Rigor 

The nature of the distribution of 
Java microperformance results also 
leads to a need for caution when 
dealing with standard statistical 
measures. In particular, measures 
such as the standard deviation can 
become very unreliable when deal¬ 
ing with these types of results. 

Too often, tools such as the stan¬ 
dard deviation are applied without 
reference to the caveats that apply 
to their use. Many people remem- 
berthe "rule" that "68 percent 
of values lie within one standard 
deviation of the mean, and 95 per¬ 
cent lie within two standard devia¬ 
tions" without remembering that 
in deriving that rule, the assump¬ 




ONE CAVEAT 


Too often, 
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A 


711,000,000 field, getter/setter=33.1 ns 

1101,000,000 field, getter/setter=25.1 ns 

50.0% delay was 23 ns 
90.0% delay was 30 ns 
99.0% delay was 43 ns 
99.9% delay was 164 ns 
99.99% delay was 248 ns 
99.999% delay was 3,458 ns 
99.9999% delay was 17,463 ns 
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tion is made that the distribution 
is normal. 

If the distribution is not normal, 
there is no general rule that can be 
made about the percentiles of an 
arbitrary probability distribution. 

In orderforour handling of sta¬ 
tistics to be watertight, we need to 
do more than accountforthe non¬ 
normal distribution of our results. 
In particular, we need to ensure 
that we perform enough indepen¬ 
dent runs to guarantee that our 
results are not affected by one run 
that might be heavily skewed by 
external noise (other processes, 
operating system tasks, or other 
system effects). 

The results that we presented 
previously were chosen from a 
large set of independent runs and 
were checked to ensure that they 
were truly representative of the 
overall statistics. 


The benchmark paper on 
the proper handling of sta¬ 
tistical results from the JVM 
is "Statistically Rigorous Java 
Performance Evaluation" by 
Georges, Buytaert, and Eeckhout 
(2007), which is available from 
several sources on the Web. For 
applications that need a very high 
level of rigor and certainty, the 
methods described in that paper 
should be followed closely. 

Finally, there is another very 
important subtlety of measure¬ 
ment that we have so far neglected. 

The Client View 

Consider a system, such as a Web 
server, for which we want to mea¬ 
sure response times. If we fol¬ 
low the measurement approach 
that we've seen so far, we would 
conclude that a certain small 
percentage of the server's page 
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response times would be slow— 
the pages that were unlucky 
enough to be in-flight when a GC 
pause started. 

However, the situation is actu¬ 
ally worse than that. Considering 
the time from the server's point 
of view is not sufficient. This is 
because requests continue to 
be sent by clients even though 
the JVM is paused for GC. These 
requests will begin to be processed 
afterthe GC cycle has completed, 
and so the measurements of their 
duration will not show any sign of 
having been held up by GC. 

From the point of view of the 
sending client, however, these 
requests will certainly have been 
affected by GC, and they will seem 
slow to the client. 

For this reason, a truly accurate 
view of a performance number, 
such as response time, must take 
into account the complete timings 
as seen by the client as well as 
the character of the distribution 
of results. 

Summary 

In this article, we've discussed 
the nature of JVM microbench¬ 
marks and shown some of the 
pitfalls of developing good 
microbenchmarks: 

■ The dynamic, managed nature 

of the JVM affects performance 

numbers. 


■ GC can have an especially large 
effect. 

■ Microbenchmark observables 
are not normally distributed. 

■ Simple descriptive measures 
(such as the mean or standard 
deviation) can be very mislead¬ 
ing for microbenchmarks. 

Most application developers 

should look to benchmark at a 
much larger scale by working with 
their entire application or a com¬ 
ponent. Even in this case, there are 
a numberof basic benchmarking 
principles that developers should 
follow when benchmarking: 

■ Understanding the overall shape 
of the distribution of perfor¬ 
mance indicators is important; 
don't rely on statistical measures 
without checking the overall 
shape of the distribution first. 

■ Make sure that enough inde¬ 
pendent runs are done to 
achieve statistical stability. 

■ Beware of the "queuing on 
the network" effect. To be 
completely accurate, we must 
measure from the client's 
perspective. </article> 
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New File System APIs in NI0.2: 
A Walkthrough 

Take advantage of the new file system APIs released in Java SE 7. 
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ava SE 7 provides new addi¬ 
tions to the NIO packages— 
the so-called NIO.2 APIs of 
JSR 203 —most of which 
focus on file system APIs and 
asynchronous channels. 

In the past, most file sys¬ 
tem operations in java were 
performed using 
the java.io package 
classes that pro¬ 
vide an abstrac¬ 
tion of system- 
dependent fea¬ 
tures. These 
classes are weak, 
for example, in 
dealing with file 
permissions and 
handling symbolic 
links. Many librar¬ 
ies were devel¬ 
oped to overcome 
these weaknesses, 
but they have the 
added expense of 
relying on either 


native libraries or external 
process invocations. Other 
libraries were also developed 
to better deal with common 
file system operations (such 
as copy, move, and explora¬ 
tion) or to provide virtual 
file systems (such as com¬ 
pressed archives, 
FTP, and HTTP). 

In this article, we 
focus on the NIO.2 
additions that are 
related to file sys¬ 
tems: operations, 
exploration, meta¬ 
data manipula¬ 
tion, and change 
monitoring. As we 
will see, the NIO.2 
APIs provide ele¬ 
gant additions to 
the java toolset. 

First Steps 

The NIO.2 addi¬ 
tions are mostly 


contained in the java.nio.file 
packages. Let's get started 
with Path, a key interface of 
the new APIs. 

Paths and files. The Path 
interface is an abstraction of 
a file ora directory within a 
given file system. Instances 
of Path can be obtained using 
the Paths class, which com¬ 
prises two get() methods: 
onetakinga URIand one 
taking a variable number of 
path elements. An example 
would be to get a Path refer¬ 
ence to the /etc/hosts file, as 
shown in Listing 1. 

A Path reference offers 
methods for compar¬ 
ing paths, resolving paths 
against other paths, and so 
on. The Files class is com¬ 
monly used to perform com¬ 
mon operations on paths, 
including the following: 

■ Creating files, directories, 
and symbolic links 


WEAK LINK 


In the past, 
most file system 
operations in Java 
were performed 
using thejava.io 
package classes, 
which are weak 
in dealing with 
file permissions 
and handling 
symbolic links. 


■ Copying, moving, and 
deleting 

■ Querying for attributes 

■ Iterating over a file system 
tree 

■ Obtaining read and write 
streams and channels 

■ Performing direct read and 
write operations 

Listing every method in 
Path and Files would certainly 
be boring, so let's instead 
look at some examples. 
Simple operations. Let's cre¬ 
ate a temporary directory and 
copy a file into it. 

Listing 2 copies the asm file 
to an asm-copy.jarfile under 
a temporary directory such as 
/var/folders/cj/h0x5ghcdl 
tz5s7shyj8txxfOOOOOgn/T/ 
nio21324767717145250358. 

Several or no CopyOption 
parameters can be pro¬ 
vided, most likely from the 
StandardCopyOption enu¬ 
meration. In Listing 2, we 
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asked to preserve the file system 
attributes, such as the owner, 
group, and permissions. Other 
options include the ability to 
perform an atomic move and 
replace existing files. There is 
also a LinkOption enumeration to 
prevent the copy operation from 
following symbolic links. 

Speaking of symbolic links, if a 
symbolic link to the original ASM 
library Java archive (JAR) didn't 
exist, we could create one and 
query the size of the JAR, as shown 
in Listing3. 

Quick reads and writes. Reading 
and writing file contents has tra¬ 
ditionally required lots of code. 

The Files 

class provides 
quick helper 
methods for 
reading and 
writing the 
contents of 
files as one- 
shot opera¬ 
tions. They 
operate either 
on strings 
or raw byte 
arrays. 

Listing 4 
shows how we 
can read the 
contents of a 
file. Writing 
some content 


to a file is equally easy, as shown in 

Listing 5. 

Integration with existing stream 
and NIO APIs. NIO.2 APIs are not 
intended to live on an isolated 
island, so they provide a means for 
integration with existing stream 
and NIO APIs. 

I/O java.io style streams and 
buffers can be obtained using the 
Files class and its newlnput 
Stream(), newOutputStream(), 
newBufferedReader(), and 
newBufFeredWriter() methods. NIO 
channels can be obtained using 
the newByteChannel() method. 

Interestingly, there is a ver¬ 
sion of the copy() method that 
can be used when the target is an 
instance of java.io.OutputStream. 

An example usage would be to 
dump the contents of a file to the 
standard output stream: 

I Files.copy(hello, System .out); 

Dealing with FileSystems 

As the name suggests, the 
FileSystem class represents an 
abstraction of a file system. It pro¬ 
vides many useful services, includ¬ 
ing the ability to access files, direc¬ 
tories, users, groups, or file system 
change notifications. 

Obtaining and using a file sys¬ 
tem reference. FileSystem is an 
abstract class. Instances can be 
obtained using the corresponding 
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// These two calls are equivalent 
Path hostsl = Paths.get("/etc/hosts"); 
Path hosts2 = Paths.get("/etc", "hosts"); 

//U) 
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FileSystems factory object. 

FileSystem contains a 
getDefault() method that returns 
the default file system, that is, 
the file system from which the 
Java Virtual Machine was invoked. 
We can obtain a reference to this 
default file system like this: 

I FileSystem fs = FileSystems. 
getDefaultQ; 

Not every file system shares the 
same properties. While UNIX- 
derivative operating systems 
share a unified file system root 
(/), Microsoft Windows has one 
root per partition and drive (C:\, 
D:\, and so on). We can check 
how many roots a given file sys¬ 
tem has by invoking the 
getRootDirectoriesQ method, 
which returns an Iterable<Path>, 
as shown in Listing6. 

An instance of FileSystem can 
also be used to retrieve Path 
instances. The methods in Path 
include manipulation methods for 


comparing paths, extracting sub¬ 
paths, computing relative paths 
between paths, and so on. 

Obtaining insta nces of Path 
from a FileSystem object is done 
by invoking the getPath() method, 
which takes a variable number of 
string arguments. Each string rep¬ 
resents a part of a path, as shown 
i n Listing 7. 

We can compare paths like this: 

I assert main.compareTo(alsoMain) 

= = 0 ; 

compareToQ returns the usual 
-1, 0, and 1 values for "less than," 
"equal to," and "more than," 
respectively. 

Listing 8 shows how a path can 
be converted to a URI or file rep¬ 
resentation. We can also perform 
some path manipulations, as 
shown in Listing 9. 

Listing the file system providers. 
There are other factory meth¬ 
ods in FileSystems that can build 
FileSystem instances for a URI or 
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path in a file system. This is espe¬ 
cially useful when concrete provid¬ 
ers act as virtual file systems over 
zip archives, HTTP or FTP con¬ 
nections, or SMB network drives. 
Using this capability, you can 
uniformly handle "real" and virtual 
file systems. 

It is possible to query the avail¬ 
able file system providers by using 
the FileSystemProvider class, a ser¬ 
vice provider interface (SPI) that is 
part of the java.nio.file.spi package. 

The code shown in Listing 10 
should return both file and JAR 
URI schemes for most installa¬ 
tions of Java SE 7. Although the 
specification does not require a 
JAR scheme provider to be avail¬ 
able, JDK 7 and OpenJDK pro¬ 
vide one. You can take 
advantage of the SPI's 
ability to contribute its 
very own file system 
providers (HTTP, FTP, 
and so on), although 
doing that is beyond the 
scope of this article. 

Let's now further 
investigate the NI0.2 
APIs by opening a zip 
file as a file system provider and 
"walking it." 

Walking a File System Provider 

The java.io.File class has list() and 
listFilesQ methods. They can be 
used for instances of File that rep¬ 


resent a directory, and they return 
a list of direct children files and 
directories. 

Slightly more-powerful mecha¬ 
nisms are provided with the java 
.nio.file.Files class: file visitors and 
directory streams, which can per¬ 
form selective filtering and match¬ 
ing for discovered elements. 

We'll look at those capabilities in 
the remainder of this section. 
Opening a zip file system. Let's 
open a JAR as a file system, as 
shown in Listing 11. 

The FileSystems class provides 
other newFileSystem factory 
methods, including one that 
takes a configuration map as a 
parameter and uses provider- 
specific keys. The format in 

Listing 11, which takes a 
Path and a ClassLoader, 
is the preferred format 
for opening a file sys¬ 
tem over a file. 

Because FileSystem 
implements 
AutoCloseable, we can 
use it as part of a try- 
with-resources state¬ 
ment that ensures 
the FileSystem.close() method is 
called, regardless of whether an 
exception is thrown. 

Path matchers. In this example, 
we are interested in printing out 
all the .class files contained within 
the archive. We can take advan¬ 
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Path main = fs.getPath("src", "discover", "nio2", "fs", "Main.java"); 
Path alsoMain = fs.getPath("src/discover/nio2", "fs", "Main.java"); 
Path src = fs.getPath("src"); 
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tage of PathMatcher to match Path 
objects against either a regular 
expression or file glob syntax using 
the match() method, as shown in 

Listing 12. 

A path matcher expression has 
the form "glob:<glob-expression>" 
or "regexp:<regular-expression>". 

An expression such as "glob:/foo/* 
.{java,class}" matches any .java or 
.class file within /foo. 

File visitors. The Visitor design 
pattern fits well with the need to 
walk a file system tree and take 
action on files. The FileVisitor<T> 
interface defines several methods 
for the following circumstances: 

■ A visitor that is notified before 
and after entering a directory 

■ A visitor that is notified when 
visiting a file 

■ A visitor that is notified when vis¬ 
iting a file through an exception 
Also, file visitor methods return 

a value as part of the FileVisitResult 


enumeration to mandate thatthe 
walk be continued, be terminated, 
skip the siblings, or skip a subtree. 
There is also a default implemen¬ 
tation called SimpleFileVisitor<T> 
that can be overridden. In our 
case, we can walk the archive file 
system from its root and print 
out .class file paths, as shown in 
Listing 13. 

We can safely ignore the attrs 
parameter of the visitFileQ method 
forthe moment; we will examine 
how file attributes can be manipu¬ 
lated later. 

Directory streams. File visitors 
are fairly customizable, but when 
all you need to look for is certain 
files in a single directory, a sim¬ 
pler solution exists in the form of 
directory streams. In a nutshell, a 
stream is simply an iterable object 
that runs over a set of paths that 
match a certain filter. It is also an 
AutoCloseable interface for use in 
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try-with- resources statements, 
because directory streams need to 
be closed. 

Listing 14 shows how we can look 
for all entries at the root of the 
previous JAR, and Listing 15 shows 
how we can pass a glob filter to list 
only thejava class files. 

More-elaborate queries can 
be implemented by passing a 
DirectoryStream.Filter object as a 
stream predicate. For example, we 
can reuse the glob matcher object 
that we used earlierto list all Java 
classes, as shown in Listing 16 

As in the case of file visitors, 
the predicate does not need to be 
based on querying a PathMatcher. 
You could, for instance, look at file 
sizes or file attributes to form que¬ 
ries such as "any executable file 
overl024kilo-octetin size." 
Copying a whole file tree into a 
zip archive. We can 
easily combine a file 
tree walker, the Files 
class operations, and 
an ad hoc file system 
to copy the entire cur- 
re nt d i recto ry fi I e t ree 
into a UTF-8 encoded 
zip archive, as shown in 
Listing 17. 

If, instead of copying 
files into a zip archive, 
we had an FTP file sys¬ 
tem to copy files to 
a remote FTP server, 


the code in Listing 17 would not 
change much, except for the file 
system creation. The Files 
.createDirectories() method covers 
the creation of all directories that 
need to exist in order to lead to the 
directory to be created. 

Manipulating Metadata 

One of the most interesting fea¬ 
tures of the NIO.2 API is the abil¬ 
ity to manipulate metadata at 
the file system level. Previously, 
information such as file owner, 
group, and access permissions 
was not available from the stan¬ 
dard Java runtime without resort¬ 
ing to external process execution 
or native code integration, both 
of which add their own sets of 
problems. While such information 
is no longer hidden, code needs 
to adapt to the capabilities of the 
runtime environment, 
because operating sys¬ 
tems and file systems 
vary greatly. 

The java.nio.file 
.attribute package 
provides support for 
accessing such meta¬ 
data, mostly by using 
a hierarchy of file attri¬ 
bute views. Each view 
represents a set of 
metadata that can be 
manipulated depending 
on what the underlying 
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Files.walkFileTree(fs.getPath("/"), new SimpleFileVisitor<Path>() { 
(©Override 

public FileVisitResuIt visitFile(Path file, BasicFileAttributes attrs) 
throws IOException { 
if (matcher.matches(file)) { 

System.out.println(file); 

} 

return FileVisitResult.CONTINUE; 

} 

}); 
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file system provides. 

The BasicFileAttributeView inter¬ 
face defines the attributes that are 
common to existing file systems, 


such as file size, last modification 
date, and creation date. Instances 

of DosFileAttributeView define attri 
butes of DOS-type file systems, 
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such as whether a file is hidden, 
a system file, or an archive. In the 
same spirit, PosixFileAttributeView 
defines attributes for POSIX sys¬ 
tems, while AcIFileAttributeView 
allows for accessing access control 
lists (ACLs) on file systems that 
support them. 

The Javadoc for the java.nio.file 
.attribute package thoroughly 
describes these views. Let's look at 
some common usage patterns. 

File attributes. The most-common 
file attributes are directly acces¬ 
sible from the Files class methods: 
size(), isDirectoryO, isRegularFilef), 
isSymbolicLink(), isHidden(), 
getLastModifiedTime(), and more. 

To access or modify a single 
attribute, you can use the get 
AttributeQ and setAttributef) meth¬ 
ods. They take a string that repre¬ 
sents the attribute, prefixed with 
an identifier of the file attribute 
view. Each file attribute view inter¬ 
face defines such strings and the 
return type of the attribute in the 
corresponding 
Javadoc. 

We can query 
the POSIX per¬ 
missions for a 
file as shown in 
Listing 18, which 
would resultin 
output similar 
to Listing 19. In 
addition, we can 


access specific attributes using 
the readAttributesf) method on any 
subclass of BasicFileAttributes, as 

shown in Listing 20. 

It is worth noting that Files.read 
Attributes(Path, BasicFileAttributes 
,LinkOptionf]) performs bulk read 
operations. This capability is useful 
performance-wise when multiple 
attributes are read simultaneously. 

POSIX file permissions can be 
directly accessed as shown in 
Listing 21. More-general cases 
can be handled by first accessing 
a file attribute view. For example, 
to obtain the POSIX file owner 
of a file, you can use the code in 
Listing 22. 

POSIX file permissions are com¬ 
monly expressed in the form of 
a string such as rwxr-xr-x, which 
means the user can read, write, 
and execute, while group mem¬ 
bers and others can only read 
and execute. We can display such 
permissions and change them, as 
shown in Listing 23, which pro¬ 
duces output similarto this: 

I Old permissions: rw-r--r— 

New permissions: rwxr-xr-x 

The Filestore class. Every path 
has an associated file store object 
that essentially represents where 
the corresponding file is stored: 
volume, partition, and so on. The 
Filestore class is useful for query¬ 
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Posix permissions for asm-all-2.2.3.jar 
-> OTHERS_READ 
-> OWNER_READ 
-> GROUP_READ 
->OWNER_WRITE 
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ing whetherfile storage supports 
a given file attribute view. It is also 
useful for accessing disk usage 
statistics. 

The code in Listing 24 a I lows us 
to perform a few queries that pro¬ 
duce output similarto the follow¬ 
ing on Mac OS X: 

/dev/diskOs2 

hfs 

169030116 / 244277768 

true 

true 

false 

Watching for Changes 

Some applications need to watch 
for file system changes. For exam¬ 


ple, an application server might 
watch for application archives to 
be dropped into a certain folder 
and then automatically deploy 
them. Similarly, integrated devel¬ 
opment environments can look for 
project files to be added, deleted, 
and modified by third-party appli¬ 
cations. Anotherexampleincludes 
some application integration pat¬ 
terns where applications exchange 
data through file deposits. 

Watching for file system changes 
can be implemented easily by 
periodically looking at the entries 
of a folderand determining which 
files have been added, removed, or 
changed based on their last modi¬ 
fication time stamp. However, 
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more-efficient mechanisms exist 
at the operating system level, such 
asinotifyfor Linux. 

NIO.2 provides a useful API 
that takes advantage of operating 
system facilities, when available, 
and falls back to periodical polling 
otherwise. WatchService provides a 
service that can be notified about 
changes for a given 
Path object. You can 
specify which types 
of events should be 
looked for, namely 
additions, modifica¬ 
tions, removals, or 
overflow (failure of the 
notification system to 
report all events). For 
example, the snippet 
i n Listing 25 looks for 
changes in /tmp and 
prints out events. 

A WatchService is 
obtained from the file 
system of the path to 
be monitored. Again, 
this is an AutoCloseable 
object, and it is a good 
idea to use it with a try-with- 
resources statement to ensure 
that it eventually gets closed. The 
watch service is then registered to 
a path, and events become avail¬ 
able from a queue. 

A WatchKeyis used in con¬ 
junction with registration and is 
returned at registration time. A 


WatchKeyis also obtained when 
looking for events by using either 
the watch service's poll() ortake() 
method. In the example in 
Listing 25, we opted to use take() 
because we can afford to wait 
fora new event to be available. A 
watch key maintains state, so we 
can query to determine whether 
it is still valid and to 
obtain the latest 
watch events. 

Once a key has 
been used, it needs 
to be reset if it is to 
be used again. The 
reset() method returns 
a Boolean value that 
will be false if the key 
is no longer valid, 
for instance, when a 
watched folder disap¬ 
pears. You can also call 
the cancel() method to 
cancel the watch ser¬ 
vice registration. 

Finally, the key has 
information about 
the event. For exam¬ 
ple, it could hold information 
on the kind of event (most likely 
from StandardWatchEventKinds) 
and a context object that is an 
instance of Path, which corre¬ 
sponds to the kind of events the 
service was looking for (ENTRY_ 
CREATE, ENTRY_MODIFY, and 
ENTRY_DELETE). 


FILTER AND MATCH 


Powerful 
mechanisms are 
provided with the 
java.nio.file.Files 
class: file visitors and 
directory streams, 
which can perform 
selective fitering 
and matching for 
discovered elements. 
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LISTING 25 


import static java.nio.file.StandardWatchEventKinds.*; 

// (...) 

Path tmp = Paths.get("/tmp") ; 

try (WatchService watcher = tmp.getFileSystem().newWatchService()) { 
boolean running = true; 

tmp.register(watcher, ENTRY CREATE, ENTRY DELETE, ENTRY MODI¬ 
FY); 

while (running) { 

Watch Key key = watcher.take(); 

for (WatchEvent<?> event: key.pollEventsO) { 

Path path = (Path) event.context(); 

WatchEvent.Kind<?> kind = event.kindQ; 

System.out.println(kind + "=>" + path); 

} 

running = key.reset(); 

} 
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Conclusion 

This article introduced the new 
file system APIs released in Java 
SE 7 as part of the so-called NIO.2 
packages. These packages make 
it easy to deal with both common 
and advanced file operations, such 
as efficiently monitoring changes 
in a folder or moving files into 
a compressed zip archive while 
preserving metadata. Last but 
not least, they integrate well with 
existing java.io and java.nio classes, 
and they can be extended to uni¬ 
formly deal with new types of file 


system providers. For more exam¬ 
ples, see the sample NIO.2 code 
in the JDK 7 distribution (under 
sample/nio/file). </articie> 

/ LEARN MORE 

■ lava SE7API 

• " File I/O (Featuring NIO.2)" lava 

Tutorial 

• NIO Project for Open] DK 

• " Better Resource Management 

with lava SE 7: Beyond Syntactic 

Sugar " 






































//enterprise java / 



ADAMBIEN 



PHOTOGRAPH BY 
THOMAS EINBERGER/ 
GETTY IMAGES 


Java EE Connector Architecture 1.6 

Java EE Connector Architecture 1.6 provides deep integration with container services in a lean way. 


M ainstream resources, 
such as persistence or 
messaging, can be accessed 
directly with dependency 
injection (DI) orJNDI lookup. 
You can easily integrate 
nonstandard resources so 
that they can also be injected 
in the application, but con¬ 
tainer services such as pool¬ 
ing, monitoring, security, or 
fine-grained transactions 
might be unavailable. 

Implementing container 
services for each resource 
type is a complex task. On 
the other hand, the Java EE 
Connector Architecture (JCA) 
provides a standard mecha¬ 
nism through which these 
container services can be 
used more simply. 

This article covers the 
implementation of a file 
resource adapterthatis based 
on JCA and is in the style of a 
key-value store, which uses a 
minimal numberof files and 
no XML, and is configured 
purely using annotations. 


JCA 1.6—Easier to Use 
than Expected 

The aim of JCA 1.6 is as 
follows: 

"The Java EE Connector 
architecture defines a 
standard architecture 
for connecting the Java 
EE platform to heteroge¬ 
neous EISs. Examples of 
EISs include Enterprise 
Resource Planning (ERP), 
mainframe transaction 
processing (TP), and 
database systems. The 
connector architecture 
defines a set of scalable, 
secure, and transactional 
mechanisms that enable 
the integration of EISs 
with application servers 
and enterprise applica¬ 
tions." (JCA 1.6 specifica¬ 
tion, JSR 322) 

Although JCA was origi¬ 
nally meant to integrate 
heavy enterprise systems, it 
is simple enough to use for 
accessing any external sys¬ 
tems. A handful of classes 


are sufficient to implement 
a fully functional resource 
adapter (connector). Version 
1.6 of the JCA specification 
makes usingXMLdeploy- 
ment descriptors for configu¬ 
rations optional by introduc¬ 
ing annotation equivalents, 
which makes the developer's 
task easier. Direct access to 
container services—such 
as work manage¬ 
ment, security, or 
transaction state- 
makes using 
the connector 
implementation 
easierthan imple- 
mentingthose 
services within an 
application. 

In this article, we 
will implement an 
outbound connec¬ 
tor that accesses 
a local file system 
with the API shown in 
Listing 1. 

The API i nterface defi ned in 
Listing 1 is going to be indi¬ 


rectly injected into the appli¬ 
cation code. As with JDBC, the 
JCA outbound artifacts are 
connection-oriented and, 
hence, connections need to 
be obtained and returned 
to the pool (for example, by 
calling connection.close()). A 
Bucket instance can be cre¬ 
ated by injecting BucketStore 
in the component bean (EJB 
bean/Servlet), as 
shown in Listing 2. 

Both files reside 
in dedicated JAR 
package-based 
Maven projects 
and are ready to 
be referenced by 
applications (see 
Listing 3). 

To compile the 
API, the interface 
javax.resource 
.Referenceable is 
needed, which 
is part of the JCA API. 
Referenceable comes with the 
Java EE 6 API as a GlassFish 
3.1.2 embedded library, 


MAKE IT SIMPLE 


JCA 1.6 provides 
a standard 
mechanism 

through which 
container 
services can be 
used more simply. 
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which is referenced once in the 
file's parent project. At the same 
time, the parentis used to build all 
modules consistently, as shown in 

Listing 4. 

Most connectorimplementa- 
tions are divided into the API and 
implementation modules. The 
Bucket interface belongs to the API 
and is built with the jar packag¬ 
ing type. The API module is built 
by a project object model (POM) 
with the jar packaging type, but 
it is enhanced with the resource 
adapter archive (RAR) plug-in, as 
shown in Listing 5a and Listing 5b. 

Both the application and the 
resource adapterimplementa- 
tion rely on the API classes for 
compilation. The parent project 
declares only the common java EE 
6 API dependency and simplifies 
the consistent building of both 
resource adapter modules. The 
client moduleisan optional sub- 
module and can be used fortest¬ 
ing and demo purposes. 

The Necessary Plumbing 

A resource adapter (connector) 
implementation can be bidirec¬ 
tional between the external sys¬ 
tem and the application server. 

The application server notifies the 
resource adapter about the state 
of transactions, connection life- 
cycle, and security. 

On the other hand, the applica¬ 


tion server expects the resource 
adapterto expose a minimal set 
of metadata. Starting with JCA 
1.6, the metadata can be provided 
as annotations instead of XML 
deployment descriptors (ra.xml). 
The FileAdapter class has the 
component-defining annotation 
((©Connector), which primar¬ 
ily indicates that the bundle is 
a resource adapter (apart from 
being packaged in .rarformat). See 
Listing6a and Listing6b. 

We don't need a reference to 
the BootstrapContext and we are 
not interested in other callback 
invocations in this case, so all the 
methods remain empty. 

Starting with the Meat... 

The implementation of BucketStore 
is trivial, as shown in Listing 7a and 
Listing 7b. 

The FileBucketStore acts as a 
ConnectionFactory, so it also has 
to implement the Referenceable 
interface from the BucketStore. 
Both the Referenceable and 
Serializable interfaces ensure 
proper registration in the JNDI 
space, as stated in the APT 

The implementation of the 
Referenceable interface only 
requires it to implement an acces¬ 
sor method pairto maintain the 
javax.naming.Reference instance. 
More interesting is the factory 
method getBucket. Instead of cre- 
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public interface Bucket extends AutoCloseable{ 

void write(Stringfile,byte[] content); 
void delete(String file); 
byte[] fetch (String file); 

(©Override 
void closeQ; 


} 
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atinga new bucket for each call, we 
are asking the ConnectionManager 
to allocate a connection with the 
passed ManagedConnectionFactory. 

An anonymous instance of the 
ConnectionRequestlnfo is passed 
as a second parameterto the allo- 
cateConnection method. Hence, 
all connections are considered as 
equal, and both the equals and 
hashCode methods are imple¬ 
mented to attest to the equal¬ 
ity of all ConnectionRequestlnfo 


instances. Future versions of the 
connector, however, could extend 
the implementation to support 
authentication. You can also pass 
"null" instead of the anonymous 
ConnectionRequestlnfo, but this 
might result in unportable code. 

The entire transactional inter¬ 
action with the local file system 
is implemented in the FileBucket 
class. In addition to the Bucket 
interface from the connec¬ 
tor's API, FileBucket also imple- 
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merits the close method from 
the AutoCloseable interface. With 
the implemented AutoCloseable 
interface, the application can rely 
on the try-with- resources mecha¬ 
nism to close connections that are 
not needed. See Listing 8a- 
Listing 8e. 

However, the FileBucket class 
delegates only all close() invoca¬ 
tions immediately to the Closeable 
interface instance passed in the 
constructor. With the begin, 
commit, and rollback callbacks, 
the FileBucket is informed about 
the transaction progress. 

Applications will use the 
FileBucket implementation to 
access the content in the local file 
system. Write and delete opera¬ 
tions are not performed directly; 
they are cached. During transac¬ 
tion commit, the method flush- 
Changes is invoked to persist the 
cache to the local file system. 

A rollback invocation, however, 
clears the cache and does not 
affect the persistence store (local 
file system). As the transaction 
begins, the method createlfNot 
Exist is invoked to create the root 
folder in the working directory. 

The Reusable Parts 

FileBucketStore is a factory of the 
FileBucket class. Both classes real¬ 
ize the file access functionality and 
are, therefore, highly domain- 


specific implementations. 
FileBucket implements the file 
access without any dependency on 
the JCA API and can be easily unit 
tested, as shown in Listing9a and 
Listing 9b. 

Both remaining classes are 
required implementations of 
the Managed Connection and 
ManagedConnection Factory 
interfaces from thejavax 
.resource.spi package. 
GenericManagedConnection imple¬ 
ments the ManagedConnection 
interface and represents the 
physical connection effectively 
managing a FileBucket instance. 

As the nameimplies, the 
GenericManagedConnection is only 
weakly dependent on any domain- 
specific implementation and can 
be reused for different resource 
adapter (connector) implementa¬ 
tions. See Listing lOa-Listing lOf. 

Most of the GenericManaged 
Connection methods are self- 
explanatory. The essential func¬ 
tionality is implemented in the 
fireConnectionEvent method. 
Events fired in this method notify 
the application server about the 
state of the ManagedConnection. 
With this callback mechanism, the 
application server is able to prop¬ 
erly manage and clean up the con¬ 
nection pool. Without the event 
notification mechanism, the man¬ 
aged connection pool would run 
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import javax. resource. ResourceException; 

import javax.resource.spi.ActivationSpec; 

i m port javax. resou rce.spi. Bootstra pContext; 

importjavax.resource.spi.Connector; 

importjavax.resource.spi.ResourceAdapter; 

importjavax.resource.spi.ResourceAdapterlnternalException; 

importjavax.resource.spi.TransactionSupport; 

importjavax.resource.spi.endpoint.MessageEndpointFactory; 

import javax.transaction.xa.XAResource; 

@Connector(reauthenticationSupport = false, 
transactionSupport = 

TransactionSupport.TransactionSupportLevel.LocalTransaction) 


Download all listings in this issue as text 


dry and then block the execution 
of the application. Because the 
sample connector supports only 
local transactions, the method 

getXAResource has to throw a 


ResourceException to indicate the 
lack of Extended Architecture 
(XA)-transaction support. 

A bit more challenging is 
the implementation of the 
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GenericManagedConnectionFactory:, 

which is shown in Listing 11a, 
Listing lib, and Listing 11c. 

Beyond trivial bookkeeping, 
the GenericManagedConnection 
class provides valuable metadata, 
such as an @ConnectionDefinition 
annotation that represents an 
outbound artifact. The application 
server uses the information pro¬ 
vided in the annotation to find the 
implementation of the domain- 
specific connector. Also interesting 
are the annotations on the setRoot 
Directory method. The 
@ConfigProperty annotation 
indicates that the property is 
configurable by a resource adapter 
user and is used to generate a 
convenient user interface. The 
@Min annotation from the Bean 
Validation specification (JSR 303) 
is used to validate the user input 
before setting the values. 

In the method match 
ManagedConnection, a 
GenericManagedConnection 
instance has to be identified 
and extracted from the set of 
all known connections. The 
ConnectionRequestlnfo parameter 
is intended to find its correspond¬ 
ing GenericManagedConnection 
instance. 

A Key-Value Store with 
Resource Adapter 

FilesResource exposes the connec¬ 


tor's functionality as a RESTful 
service implemented as an EJB 
bean. The BucketStore can be 
conveniently injected with the 
(©Resource annotation into any 
java EE component, as shown in 
Listing 12a and Listing 12b. 

The injected BucketStore 
instance acts as a Bucket factory. 

In the FilesResource example, the 
Bucket instance is declared in atry- 
with-resources statement. Because 
the Bucket instance implements 
java.Iang.AutoCloseable, it will be 
closed regardless ofwhetherthetry 
statement completes normally or 
abruptly. 

BucketStore can be injected 
with an (©Resource annotation 
containing a valid JNDI name of 
the connector resource. The JNDI 
name needed for injection is con¬ 
figured during the connector's 
deployment. 

Deploying and Installing the 
Connector 

A standalone connector will be 
packaged as a RAR file and needs 
to be deployed first. In GlassFish, 
you can deploy the RAR using the 
following command-line interface 
(CLI) command orthrough the 
Web-based administration console. 

I SGLASSFISH_HOME/bin/asadmin 
--port 4848 deploy --force ./ 
sto re / ta rget / j ca - fi I e - sto re. ra r 
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importjava.io.*; 

importjava.nio.file.Files; 

importjava.nio.file.LinkOption; 

import java.nio.file.Path; 

import java.nio.file.Paths; 

importjava.util.Map.Entry; 

importjava.util.Set; 

importjava.util.concurrent.ConcurrentHashMap; 
import java.util.concurrent.ConcurrentSkipListSet; 
import javax. resource. Resou rceException; 
import org.con nectorz.fi les. Bucket- 

public class FileBucket implements Bucket { 

private String rootDi rectory; 

private ConcurrentHashMap<String, byte[]> txCache; 
private Set<String> deletedFiles; 
private Closeable closeable; 
private PrintWriter out- 

public FileBucket(PrintWriterout, String rootDi rectory, 
Closeable closeable) { 
this.out = out; 

this. rootDi rectory = rootDi rectory; 

this.closeable = closeable; 

this. txCache = newConcurrentHashMap<>(); 

this.deletedFiles = newConcurrentSkipListSet<>(); 

} 
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Figure 1 


Afteryou successfully deploy 
the connector, it is still not usable 
until you complete the configura¬ 
tion that is required for integration 
with the application server and 
the clients. This task might involve 
setting appropriate external end¬ 
point information, such as the 
host name, port, user, password, 
and so on. 

Step 1: Configure a thread pool. A 

dedicated thread pool significantly 
simplifies management and moni¬ 
toring. The New Thread Pool wizard 
in the GlassFish GUI (shown in 
Figure 1) allows you to create and 
configure a new thread pool. 

The file connector does not 
start any new threads, and it 
does not rely on the WorkManager 
functionality. The file system is 


accessed without involving the 
WorkManager, so in this case, the 
WorkManager settings are not 
required. However, an asynchro- 
nousfile connectorimplementa- 
tion would usually rely on a dedi¬ 
cated thread pool. 

Step 2: Configure a resource 
adapter. Afteryou create the pool 
using the default values, you 
need to use the New Resource 
Adapter Config wizard (shown in 
Figure 2) to create a new resource 
adapter configuration and point 
to the thread pool that was cre¬ 
ated. This instantiates the con¬ 
nector, but the connector is 
still not visible to applications. 
However, the connector becomes 
available forfu rther configuration 
after this step. 
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public class FileBucketTest { 


FileBucketcut; 

String directory = "./current"; 

Closeable closeable; 

@ Before 

public void initialize() { 
this.closeable = mock(Closeable. class); 
this.cut = new FileBucket(new PrintWriter(System.out), 
directory, this.closeable); 

} 

@Test 

public void autoClose() throws Exception { 
try (FileBucket bucket = new FileBucket( 
new PrintWriter(System.out), directory, this.closeable);) { 
bucket.begin(); 

} 

verify(this.closeable).close(); 

} 

@Test 

public void writeAndRollbackQ throws Exception! 
final String key = "hey"; 
this.cut.begin(); 

final byte[] content = "duke".getBytes(); 

this.cut.write(key, content); 

byte[] actual = this.cut.fetch(key); 

assertThat(actual,is(content)); 

this.cut.rollback(); 

actual = this.cut.fetch (key); 

assertNull(actual); 


} 
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Step 3: Create a connection pool. 

Afteryou configure the resource 
adapter, you need to create a con 
nection pool for the BucketStore 
factory, as shown in Figure 3. 

In this step, from the previ¬ 


ously declared connector named 
jca-file-store, you choose the 
BucketStore factory, which rep¬ 
resents a connection factory. 
Note that BucketStore is declared 
as a connection factory in the 
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importjava.io.Closeable; 
import java.io.PrintWriter; 
i m po rt j a va. uti I. Li n ked Li st; 
import java.util.List; 

import javax.resource.ResourceException; 
import static javax.resource.spi.ConnectionEvent.*; 
import javax.resource.spi.*; 
import javax.security.auth.Subject- 
import javax.transaction.xa.XAResource; 
public class GenericManagedConnection 

implements ManagedConnection, LocalTransaction, 

Closeable { 

private ManagedConnectionFactory mef; 

private PrintWriter out- 

private FileBucketfileConnection; 

private Con nection Requestlnfo con nection Requestlnfo; 

private List<ConnectionEventListener> listeners; 

private final String rootDirectory; 

GenericManagedConnection(PrintWriter out, String root Directory, Man 
agedConnectionFactory mef, 

Con nection Requestlnfo connectionRequestlnfo) { 
this.out = out; 

this. rootDirectory = rootDirectory; 
this, mef = mef; 

this.connectionRequestlnfo = connectionRequestlnfo; 
this.listeners = new LinkedList< >(); 
this.fileConnection = 

new FileBucket(out,this.rootDirectory,this); 

} 
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GenericManagedConnectionFactory 

instance, and the applica¬ 
tion server will detect it 
appropriately. For reference, 
the @ConnectionDefinition 
annotation defined in the 
GenericManagedConnectionFactory 
is shown in Listing 13. 

Right after declaring the con¬ 
nector connection pool, you will 
have to specify the pool settings, as 


shown in Figure4. 

It is difficult to predict opti¬ 
mal values, so it is far easier to 
start with the defaults and con¬ 
tinuously tune the settings after 
performing stress tests. It is 
interesting to note that Glass- 
Fish also recognizes custom con¬ 
figuration entries declared in the 
GenericManagedConnectionFactory 
(see Listing 14). 



Figure 4 
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importorg.connectorz.files.BucketStore; 

importjava.io.PrintWriter; 

import java.io.Serializable; 

import java.util.Iterator; 

importjava.util.Objects; 

importjava.util.Set; 

importjavax.resource.ResourceException; 
importjavax.resource.spi.*; 
import javax.security.auth.Subject; 
import javax.validation. constraints. Min; 
import org.con nectorz.fi les. Bucket; 

@ConnectionDefinition(connectionFactory = BucketStore.dass, 
connection Factorylm pi = FileBucketStore.dass, 
connection = Bucket.class, 
connectionlmpl = FileBucket.dass) 

public class GenericManagedConnectionFactory 

implements ManagedConnectionFactory, Serializable { 

private PrintWriterout; 
private String rootDi rectory; 

public GenericManagedConnectionFactoryO { 
out = new PrintWriter(System.out); 

} 

@Min(l) 

@ConfigProperty(defaultValue = "./store/", 
supportsDynamicUpdates = true, description = "The root folder 
of the file store") 

public void setRootDirectory(String rootDi rectory) { 
this. rootDi rectory = rootDi rectory; 

} 
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Figure 5 


With the exposed root 
Directory property in the 
GenericManagedConnectionFactory, 

you can set the location of the 
root folder directly from the Web- 
based administration console. The 
administration view is generated 
from the setRootDirectory method's 
metadata, for example, the name, 
the para meter type, and the 
@ConfigProperty and @Min anno¬ 
tations. Interestingly, the Bean 
Validation annotation (JSR 303) 
can be used to verify user input 
and to prevent invalid entries. 

Step 4: Specify the JNDI name. 

The last step is to register the 
freshly configured connection pool 
with the custom JNDI name, as 
shown in Figure 5. Java EE compo¬ 
nents can use the specified JNDI 
name for dependency injection of 
the BucketStore instance. 


Conclusion 

Afterthe configuration of all cus¬ 
tom values, the file connector's 
resources can be injected into Java 
EE components with the pre¬ 
configured JNDI name. With the 
exposure as a RESTful resource, 
all theJCAfile connectorfunc- 
tionality becomes available to any 
HTTP clients. For Java clients, the 
easiest way to interact with the 
FilesResource is to use the stan¬ 
dardized JAX-RS 2.0 client (see 
Listing 15a and Listing 15b.) 

AJCA connectorimplementa- 
tion, comprising a few classes and 
no XML deployment descriptors, 
allows you to "legally" access files 
in a Java EE environment. But the 
actual benefit is having access to 
the files in a transactional, secure, 
managed, and monitorable way. 

In addition, you can easily 
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@ConnectionDefinition(connectionFactory = BucketStore.dass, 

connectionFactorylrnpl = FileBucketStore.class, 
connection = Bucket.class, 
connectionlmpl = FileBucket.class) 
public class GenericManagedConnectionFactory{} 
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throttle the concurrency to the 
exposed resource by configuring 
the resource adapter's connection 
pool. Resource adapter monitor¬ 
ing information (connection pool, 
work manager, and so on) is also 
exposed by the application server. 
GlassFish makes the monitoring 
data available through RESTful 
services, which simplifies manage¬ 
ment and monitoring. </articie> 
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Payment API—Getting Started 
with JSR 229 

Learn to use JSR 229 in Java ME applications and games. 
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I n-app transactions allow 
gamers and app users to 
enjoy a seamless payment 
transaction without needing 
to leave the game or applica¬ 
tion. In this article, I will cover 
the Payment API (JSR 229) 
available to developers of 
Java ME applications and 
games and show how to use 
it with the help of a sample 
application that simulates 
the Payment API in action. 

Note: The source code 
for the sample application 
described in this article 
can be downloaded as a 
NetBeans project Inere. 

Payment API Background 

The Payment API defined 
by JSR 229 has been kept 
very simple to allow for vari¬ 
ous interpretations. This is 
a good thing, because the 
API makes it easy to create 
adapters , which are what 


drive the underlying pay¬ 
ment processing from within 
a game or application. 

The API is defined in the 

javax. microedition, payment 

package and contains two 
interfaces, one concrete class, 
and four exception classes. 

Transaction Record and 
Transaction Listener 
Interfaces 

The interface 
Transact!on Record repre¬ 
sents a record of a trans¬ 
action undertaken by the 
Payment API's modules. To 
represent the state of these 
records, it uses an integer 
flag with one of these values: 
TRANSACTION .SUCCESSFUL, 
TRANSACTION .FAILED, or 
TRANSACTION .REJECTED. 

In addition, it contains five 
informational methods 
that provide metadata about 
the record: 


int getFeaturelDQ— A fea¬ 
ture is something that can 
be charged for or must be 
paid for (for example, a 
higher level in a game ora 
value-added service). Each 
feature must be assigned a 
unique identifier, and this 
method returns the value of 
the identifier (as provided 
by the application devel- 
opertothe payment mod¬ 
ule). So, each transaction 
record must be associated 
with an application feature, 
int get 

TransactionID() — 

This is a plat- 
form-unique 
identifier for 
the transaction 
record. 

int getState() — 

This indicates 
whetherthe 
transaction was 
completed suc¬ 


cessfully, failed, or was 
rejected by the user. 

■ longgetFinished 
TimestampO —This indi¬ 
cates at what time the 
payment module acknowl¬ 
edged this transaction. 

■ boolean wasMissedQ —This 
indicates whetherthe 
transaction record was 
processed in a previous 
session rather than in the 
current session. 

The interface 

Transaction Listener is a sim¬ 
ple listener inter¬ 
face that enables 
developers to know 
when a transaction 
has been processed 
(successfully or 
otherwise). The 
transaction module 
does the process¬ 
ing asynchro¬ 
nously and pings 
the listener when 



The Payment 
API has been 
kept very 
simple to allow 
for various 
interpretations. 
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it is done. This interface 
defines only one method: 
processed (Transaction Record 
record). 

TransactionModule Class 

TheTransactionModule class calls 
the processed (Transaction Record 
record) method of the 
TransactionListener when the 
transaction has been performed 
(successfully or otherwise). The 
record holds all the data and the 
state of the transaction. 

In a nutshell, the 
TransactionModule class is the go- 
between foryour application and 
the underlying payment module. 

It defines the process(intfeatureID, 
String featureTitle, String feature 
Description) and process(int 
featurelD, String featureTitle, String 
featureDescription, byte[] payload) 
methods that your application 
calls each time it wants to charge 
the user for a 
new feature that 
the user must 
pay for. These 
methods return 
immediately, 
and the state of 
the transaction is 
sent to any lis¬ 
tener registered 
by the module, as 
discussed in the 
previous section. 


Calling either of these two meth¬ 
ods causes the payment module to 
interact with the end users by cre¬ 
ating a GUI that shows the feature 
Title and featureDescription, along 
with the price of the requested 
feature so users can confirm 
that they would like to make the 
purchase. This visual request is 
accompanied by a few other 
fields that validate the accuracy of 
the payment. 

Of course, this display occurs 
only ifthe data thatis passed to 
either of the process methods is 
valid. For example, if either 
featureTitle or feature 
Description is null or empty, the 
method will instead throw a 
TransactionModuleException. If a 
listener hasn't been registered by 
calling the setListener() method 
before either of the process meth¬ 
ods is called, the method will throw 
a TransactionListenerException. As 
we will see, a Transaction 
FeatureException is thrown ifthe 
payment module doesn't know 
about this feature via the java 
archive (JAR) manifest file. 

The second process method 
accepts a payload in the form 
of a byte[] array, which can be 
sent on to the payment process¬ 
ing adapters for extra informa¬ 
tion about the transaction. A 
TransactionPayloadException is 
thrown ifthe underlying adapter 


ABOUT THE API 


The API simply 
leaves the 
actual payment 
processing 
part up to the 
underlying 
adapters. 
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cannot process this payload. 

Finally, these methods return 
a unique int identifier that can be 
used to identify and differentiate 
this payment request from others. 

The TransactionModule class 
defines only one constructor, 
TransactionModule(Object obj), 
which normally takes a refer¬ 
ence to the MIDIet it is running 
in. If there is a problem with the 
underlying payment module 
not being correctly set up, call¬ 
ing this constructor will throw a 
TransactionModuleException. This 
constructor is the starting point for 
all payment-related operations. 

The TransactionModule class 
also defines the deliverMissed 
Transactions!) method, which is 
used in case an application crash 
occu rs after a process() ca 11 was 
initiated but before the listener's 
processed() method could be 
called. This method then attempts 
to deliver all these missed 
transactions. 

One last method is the 
getPastTransactions(int max) 
method, which returns an array 
ofTransactionRecords that have 
been processed by the current 
application. 

Provisioning Adapters 
and Features 

All this information about the 
API is important, but it doesn't 


fully answerthe question about 
how and when the application 
processes the payment. The API 
simply leaves the actual payment 
processing part up to the under¬ 
lying adapters. Device manufac¬ 
turers provide these adapters, 
regardless of whether they are a 
premium-priced SMS adapter or 
an adapterto charge a paymentto 
a credit card. 

As an application developer, 
you have little control over adapt¬ 
ers. You can request that a par¬ 
ticular payment adapter be pres¬ 
ent, but you cannot mandate it. 

If none of your requested adapt¬ 
ers are available or configured 
correctly, your application will 
not run on the device. So well in 
advance, you need to be sure that 
the target devices foryour appli¬ 
cation or game will support the 
payment adapters. 

However, you have full con¬ 
trol over the provisioning of your 
features, which is done via the 
JAR manifest file of your MIDIet 
application. In this section, I will 
show how to define features and 
how they translate to payments 
in the underlying Java Application 
Descriptor (JAD) and JAR mani¬ 
fest files. 

Let's assume that you are creat¬ 
ing an application that is based on 
th efreemium model, in which the 
basic app and some features are 
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Table 1 

free but premium features require 
payment. Let's further assume 
that there are three pricing plans, 
as shown in Table 1. 

Defining Adapters 

To get started, you need to define 
at least two entries in yourJAD file: 
Pay-Version and Pay-Adapters. 

Pay-Version is simply the version 
that correlates the JAD file and the 
JAR manifest file. It is usually 1.0. 

Pay-Adapters is a list of comma- 
separated adapters that your 
application is happy to work with. 
At least one of these adapters 
must be supported on the target 
device oryour application cannot 
run. This information is defined 
in the JAD file because the JAD file 
is what is read by a device before 
installing a MIDIet and the device 
can, therefore, reject the MIDIet 
if none of the adapters are sup¬ 
ported on the device. 

An example JAD should, mini¬ 
mally, contain entries like this: 

I Pay-Version: 1.0 

Pay-Adapters: PPSMS, X-CCARD 


>- 

i- 


PPSMS and X-CCARD are names 
of payment adapters that are sup¬ 
ported by the Java ME toolkits. 
PPSMS refers to a premium-priced 
SMS adapter, while X-CCARD is a 
nonstandard credit card adapter. 
The Payment API mandates that 
all devices that implement the 
Payment API must, at the very 
least, support PPSMS. 

The specification for the 
Payment API defines several other 
entries that can go in the JAD file 
for debugging and testing. 

Defining Payment Providers 

Each adapter, as defined in the pre¬ 
vious section, can work with mul¬ 
tiple providers. For example, Visa, 
MasterCard, and American Express 
are examples of payment providers 
for the payment adapter X-CCARD. 

Each provider needs to be 
defined within the JAR manifest 
file using the Pay-Providers and the 
Pay-<ProviderTitle>-Info attributes. 
Each pay provider listed in the 
Pay-Providers attribute must have a 


corresponding Pay-<ProviderTitle>- 
Info attribute. An example JAR 
manifest file with these entries is 
shown here: 

I Pay-Providers: ATT, VISA 

Pay-ATT-Info: PPSMS, USD, 999, 99 
Pay-VISA-Info: X-CCARD, USD, VISA 

In essence, we are saying that our 
application works with the payment 
providers AT&T and Visa, and that 
AT&T payment is via the premium- 
priced SMS adapter (defined earlier 
in the JAD file) and the Visa pay¬ 
ment is via credit card (again, as 
defined earlier in the JAD file). 

Further, for each payment pro¬ 
vider, we list the currency that 
is accepted and more payment- 
specific information. For AT&T, 
we have listed the Mobile Country 
Code (MCC) 999 and the Mobile 
Network Code (MNC) 99. 

Connecting Payment Providers 
to Features 

Having defined the payment 


adapters and the payment provid¬ 
ers, it's time to create the correla¬ 
tion between the pricing model 
that we talked about earlierfor 
ourfreemium application and 
the relevant entries in the JAR 
manifest file. We do this using 
the Pay-Feature-<n> and the Pay- 
<ProviderTitle>-Tag-<n> attributes. 
(Of course, you don't need to 
define the free pay structure; you 
need to define only the paid levels.) 

Each feature (that is, each pay¬ 
ment) maps to each provider title 
using tags that use incremental 
tag numbers with no gaps and 
with numbers starting at 0. The 
first feature is Pay-Feature-0, 
which must map to each provider 
title using the tag number 0. See 
Table 2 for clarification. 

So, for the end user to pay $5.00 
for the upgrade to the business 
level, we define the Pay-Feature-0 
attribute with a value of 0. This 
value is used to map to the two 
provider titles we defined earlier. 
Since we don't know which pay- 


PLAN 

PRICING 

/VALUE OF THIS ATTRIBUTE 

/VALUE OF THIS ATTRIBUTE 

FREE 

FREE 

NOT REQUIRED 

NOT REQUIRED 

BUSINESS 

$5.00 

Pay-Feature-O/O 

Pay-ATT-Tag-0/5.00, 55500 00, 500 
Pay-VISA-Tag-0/5.00, 500 

PROFESSIONAL 

$10.00 

Pay-Feature-1/1 

Pay-ATT-Tag-l/lO.OO, 5550000,1000 
Pay-VISA-Tag-1/10.00,1000 


Table 2 
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merit adapter might be present on 
the device or which payment type 
the user might choose, we need 
to provide this information in the 

Pay-<ProviderTitle>-Tag-<n> attri¬ 
bute for each provider: 

I Pay-Feature-0:0 

Pay-ATT-Tag-O: 5.00, 5550000, 500 
Pay-VISA-Tag-O: 5.00, 500 

For the AT&T tag, we are saying 
that $5.00 needs to be charged for 
the phone number 5550000, and 
500 is a reference number. For the 
Visa tag, we are saying that $5.00 
needs to be charged with a refer¬ 
ence number 500. 

This is the basic 
information we need 
to provide in our]AD 
and JAR manifest files. 

After this point, it is left 
to the underlying pay¬ 
ment adapter built into 
the device to inform the 
user about the payment 
options (PPSMS or 
X-CCARD) and to ask for 
more relevant informa¬ 
tion (for example, the 
credit card details). 

Updating Payment 
Information 

Things change, and 
so will your payment 
options. Due to infla¬ 


tion, you might decide to ask 
for more next year for the same 
things. Oryou might want to 
update the list of payment pro¬ 
viders that you will accept pay¬ 
ments from. The Payment API 
makes it easy to update your pay¬ 
ment information by providing 
two (mandatory) fields: 

I Pay-Update-Stamp 
Pay-Update-URL 

The first field states the date 
from which the payment informa¬ 
tion within the JAR manifest file 
is valid. The second is a link to a 
file with the extension .jpp, which 
defines any updated 
payment informa¬ 
tion. This .jpp file is 
essentially in the same 
format as the JAR 
manifest file. 

This information is 
provided to end users 
each time they make 
a payment to let them 
know the last time a 
payment was gen¬ 
erated and to alert 
them that an update 
might be available. 
End users may then 
choose to check 
whether an update 
is available before 
proceeding with the 


CHANGE IS EASY 


Things change, 
and so will 
your payment 
options. You might 
want to charge 
more next year. The 
Payment API makes 
it easy to update 
your payment 
information by 
providing two 
(mandatory) fields. 
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Figure 1 

payment and paying with the 
updated information. 

Sample Application 

Before running our sample appli¬ 
cation, there are some caveats that 
you should understand. 

Different versions of the Oracle 
emulator provide different pay¬ 
ment adapters. The Sun Java 
Wireless Toolkit for CLDC 2.5.2 
from Oracle provides a credit card 
adapter, which is missing in the 
Sun Java Wireless Toolkit for CLDC 
3.0.5 from Oracle. So, to see the 
credit card adapterin action, you 
will need to install the older tool kit 
and use it as your target platform. 
Also, if you use the PPSMS 


ED 

$5.0Q 

Would you lice to donate $5.00 to Vifcrtm's 
Charity? 


Are you sure, you want to buy this feature for 
EUR 5.00 using Credit Card Adapter provided by 
VISA? 

Pay by ♦ Credit Card Adapter - VISA 

Update date: never 

Update stamp: Thu Aug 12 J 3:30:00 UTC 2004 


Update 


Mo_Yes 

Figure 2 

adapter, yourtarget device must 
be configured with the right MNC 
and MCC codes. I have used 999 
and 99 respectively in my JAR 
manifest file, and these are the 
same values that must be present 
in yourtarget device. Howyou do 
this depends on the toolkit that 
you use. For toolkit version 3.0.5, 
this information can be seen and 
updated usingthejava ME -> 
Device Selector menu option. 

The sample application is 
fairly simple. Figure 1 shows a 
screenshot using the Lightweight 
User Interface Toolkit (LWUIT) 
interface. 

In the application, I am asking 
users to donate to, ahem, Vikram's 
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X-jir 


Credit card payment 


Amount: 5 00 EUR 


Card type: VISA 
Card Holder: 


Card Humber: 


Expiration (mm/yyyy): 
Verification: 


Cancel 


Purchase 


Figure 3 



Figure 4 


Charity. I have provided two pay¬ 
ment values orfeatures ($5.00 or 
$10.00). When the user selects Go 
(after making a value selection), 
the Payment API takes 
over because I make 
the call to the transac¬ 
tion module's process 
method (see Listing 1). 

We make the main 
thread wait until the 
payment has been 
processed (approved, 
rejected, or failed). We 
will get a call back in the 
transaction module's 
processed method (see 
Listing 2). 

The first thing we do is 


The Payment 

API is gaining 
popularity and 

islikelytobea 
popular choice 
for implementing 
payment options 
in the future. 


wake up the main thread by call¬ 
ing notify(). Finally, we look at the 
transaction record to see whether 
the transaction was successful, 
rejected, or failed and 
then present a message 
to the user accordingly. 

Figure 2 shows the 
payment information 
being presented to the 
user for confirmation 
of the payment. Note 
the update data being 
presented. You have no 
control overthe look and 
feel of this screen (or 
the next screen), which 
is controlled by the 
underlying adapter. I am 
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try { 

int selectedld = selection.getSelectedlndexO; // what was selected 
// process it 
module.process( 
selectedld, 

"Donate " + (selectedld = = 0 ? "$5.00": "$10.00"), 

"Would you like to donate" + (selectedld = = 0 ? "$5.00" : "$10.00") + 
" to Vikram's Charity?"); 

// and then wait.... until we get notified that the 
// payment is processed 
synchronized(this) { 
try { 
wait(); 

} catch(InterruptedException ie) { 

} 

} 

} catch(Exception ex) { 
handleError(ex); 

} 


Download all listings in this issue as text 


using toolkit version 2.5.2 in this 
example to show the credit card 
transaction. 

Figure 3 shows the credit card 
information being requested from 
the user after the user selects Yes 
in Figure 2. Again, you have no 
control over this process or the 
look and feel of this screen. 


Figure 4 shows the result of a 
transaction that failed due to tech¬ 
nical errors. 

Finally, Figure 5 and Figure6 

show the application being run 
in toolkit version 3.0.5 using the 
PPSMS as the underlying adapter, 
with the transaction being 
successful. 
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Donate 93-0'Q 


Would you like to donate $5.00 to Vikram's 
Charity? 


Are you sure, you want to buy this feature for 
EUR 5.00 using Premium Priced SMS provided 
by MyCompany? 

Pay by [ Premium Priced SMS - My Company , V 


Update date: never 

Update stamp: Thu Aug 12 23:30:00 GMT+10:00 
2004 


I Update J 


Ho tw 


Figure 5 



Figure 6 


Conclusion 

Although there are not many 
devices that implement the 
Payment API at this point, it is 
gaining popularity and is likely 
to be a popular choice for imple¬ 
menting payment options in the 
future. The Payment API makes 
the task of collecting funds from 
your target audience much easier 
because it leaves the final steps up 
to the device manufacturers. 

This article introduced the 
Payment API as defined by 
JSR 229 and described howto 
define payment adapters, provid¬ 
ers, and features within your JAD 
and JAR manifest files. Finally, 
it showed a simple example of 


this API in action using two tool¬ 
kits with two different payment 
adapters. </article> 

/learn more 

• JSR 229 specification 

• Download the toolkits 
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Oracle Berkeley DB Java Edition’s 
Java API 


TEDNEWARD 



PHOTOGRAPH BY 
PHILSALTONSTALL 


Learn how to work with the base API of Oracle Berkeley DB. 


< 

< 




I n Part 1 ofthisseries, we 
looked at some Oracle 
Berkeley DB basics. 

Oracle Berkeley DB is a 
two-level data storage sys¬ 
tem that, when viewed from 
a really high level, looks 
vaguely relational on the 
surface, but it offers a much 
more "object - 
binary"-ish feel for 
managingdata. 

Below that, there 
is a lower-level, 
more "key-value"- 
ish API called the 
base API, which 
offers even more 
flexibility in how 
data is managed 
and how data stor¬ 
age is customized. 

We did not cover the base 
API in the last article, despite 
the fact that it is a lower-level 
API that offers some inter¬ 
esting solutions that other 
higher-level approaches 


would find difficult orimpos- 
sibleto offer. 

Base API 

Fundamentally, the base 
API of Oracle Berkeley DB 
models a key-value store, 
meaning each database- 
each database object, to be 
precise—is like 
one giant two- 
column table, the 
first column being 
a primary key col¬ 
umn and the sec¬ 
ond column being 
a binary large 
object (BLOB) in 
relational terms. 

In Oracle 
Berkeley DB 
terms, each key- 
value pair is a record, each 
of which is a DatabaseEntry 
class that is (internally) basi¬ 
cally just a byte array. 

I did mention that this is 
low-level access, right? 


Opening and Closing 
a Database 

Opening a database in the 
base API is pretty similar 
to creating an EntityStore 
from the Direct Persistence 
Layer (DPL), which is 
the layer we discussed 
in Part 1. We begin with 
the same Environment 
and EnvironmentConfig 
classes, only this time we 
use Environment and a 
DatabaseConfig object to 
open a Database object (as 
shown in Listing 1) instead of 
using a StoreConfigto yield 
an EntityStore object. 

Once again, the 
DatabaseConfig object serves 
as the means by which we 
configure the behavior of 
the database. Of course, 
Newton's Law of Software 
("What must be opened, 
must be closed") still holds, 
so we need to make sure we 
close everything: 


@After public void close() 

{ 

db.close(); 

dbEnv.close(); 

dbDir.delete(); 

} 

Remember, Oracle 
Berkeley DB will throw 
an exception if you fail 
to close these, so if an 
IllegalStateException: 
Unclosed Database: (your 
database name) is thrown 
from the java Virtual 
Machine, you left one of 
these guys unclosed. 

Temporary Databases 

One of the uses to which 
Oracle Berkeley DB data¬ 
bases were frequently put 
in the UNIX world was as 
a temporary data store to 
hold in-flight data while the 
program was running, but 
serving no "persistence" 
purpose. In other words, the 


IT’S SO EASY 


Compared to 
other database 

systems, reading 
from and writing 
tothe baseAPI is 
absurdly simple. 
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data was irrelevant and meaning¬ 
less once the program quit, and 
in some cases, the data even cre¬ 
ated problems if it survived for the 
next run. (Think about a program 
thatwas readinginput, calculating 
interim results, and storing them 
on disk to avoid having to hold 
all of them in memory, and then 
calculating more results and writ¬ 
ing the final data somewhere else; 
those interim results written to 
disk would confuse the next run of 
the program.) 

In orderto help ensure that 
those unwanted bits don't survive 
past the run of the program, the 
Oracle Berkeley DB APIs offer the 
option to make the database tem¬ 
porary, meaning all the files rep¬ 
resenting the database are nuked 
when the program terminates. (To 
be quite precise about this, if the 
system can avoid writing to disk 
at all, it will, making these essen¬ 
tially in-memory databases. But 
the documentation specifically 
states that it is unsafe to assume 
that no disk I/O will occur. If all the 
data can't be maintained in cache, 
something will be written to disk, 
and then those files will be blown 
away later.) Because the system no 
longer has to worry about persist¬ 
ing data to disk, temporary data¬ 
bases are blazingly fast, though the 
obvious trade-off is the complete 
loss of data in the event of a crash. 


To mark a database as a tem¬ 
porary database requires one 
call, setTemporary(true), on the 
DatabaseConfig object that is 
used to open the database. But 
beware: the disk underneath the 
configuration does matter, even if 
you never actually write to it. If, for 
example, you open an Environment 
on top of a directory in which a 
nontemporary database previously 
existed, Oracle Berkeley DB will 
throw another IllegalStateException 
claimingthatthe database can't 
be made temporary if it previously 
wasn't temporary. 

Reading from and Writing to 
a Database 

Compared to other database sys¬ 
tems, reading from and writing to 
the base API is absurdly simple. 
Remember, it's a byte-array key- 
value store, so storing data to it 
consists of calling put with the key 
byte array and the value byte array, 
as shown in Listing 2. 

I did mention that this is low- 
level access, right? 

The first parameter for put is a 
Transaction object, which we can 
ignore (for now) because we want 
to keep things simple (and non¬ 
transactional). And, in the interest 
of reinforcing a point about the 
base API, the count() method on 
the Database object is a count of 
all the key-value pairs in the entire 
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LISTING 2 / LISTING 3 / LISTING 4 


File dbDir = new File("./data"); 

Environment dbEnv; 

Database db; 

@Before public void open() 

{ 

if (IdbDir.exi sts()) 
dbDir.mkdirQ; 

EnvironmentConfig config = new EnvironmentConfigO; 

config.setAI lowCreate(true); 

dbEnv = new Environment(dbDir, config); 

DatabaseConfig dbConfig = new DatabaseConfigO; 

dbConfig.setAllowCreate(true); 

db = dbEnv.openDatabase(null, "database", dbConfig); 

} 


Download all listings in this issue as text 


database, because, as I mentioned 
earlier, the database is essentially 
one giant collection of key-value 
pairs. Thus, we write one record 
and then assert to ensure that the 
database holds exactly one record. 

The way to read a key-value pair 
from the database is pretty pre¬ 
dictable (see Listing 3). 

The first parametertotheget call 


is, again, a Transaction object, and 
the last is a LockMode enumeration 
that describes what kind of con¬ 
currency locks should be used- 
null states use the default settings 
given by the DatabaseConfig when 
the database was opened. 

Removing a key-value pair from 
the database is equally predict¬ 
able, as shown in Listing4. And, 
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with equal predictability, the first 
parameter to the delete call is, 
again, a Transaction object. 

By the way, if you prefer to work 
with transactions, obtain one from 
the Environment and pass it in as 
the first parameterto any of these 
calls; this is a little bit beyond 
the scope of this article, but if 
you're familiar with transactions 
from relational databases, the 
Transaction object's API should be 
pretty easy to understand. 

Deferred-Write Databases 

One of the principal advantages 
the base API (and, in fact, Oracle 
Berkeley DB as a whole) offers is 
speed—for almost any 
operation done against 
an Oracle Berkeley DB 
database versus a tradi¬ 
tional SQL database, the 
Oracle Berkeley DB API 
will be faster, though 
in many cases, things 
will be surrendered to 
get that speed (see our 
previous discussion of 
in-memory databases, 
for example). 

One way that an 
Oracle Berkeley DB 
database can offer even 
higher performance is 
to defer the writes to 
disk to be done when 
convenient, as opposed 


to being done at the time of the 
put call. These are called deferred 
writes, and they offer a huge 
performance boost for systems 
whose data durability concerns 
aren't stringent. 

Opening a database in 
deferred-write mode means call¬ 
ing setDeferredWrite(true) on the 
DatabaseConfig object before it is 
used to create the Database object. 
Once that is done, all writes to 
the database will be delayed until 
the developer calls sync() on the 
Database object to force a data 
write (which is also called a check¬ 
point ora barrier in some concur¬ 
rency literature). 

The reason for the 
improved performance 
is simple: by deferring all 
the writes to disk until 
the developer issues 
thesync() call, Oracle 
Berkeley DB can do any 
updates to those just- 
written records in mem¬ 
ory, rather than having 
to seek to disk and write 
them there, and then 
later it can write out only 
the final results of those 
updates. 

Think, for example, of 
the benefits of deferred 
writes in a common 
end-user scenario: A 
user creates a record, 


Because the 
system no longer 
has to worry about 
persisting data to 
disk, temporary 
databases 
are blazingly 
fast, though the 
obvious trade-off 
is the complete 
loss of data in the 
event of a crash. 
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edits the record, edits it some 
more, then realizes the record 
is unnecessary, and deletes the 
record. In a deferred-write sce¬ 
nario, when the developer finally 
calls sync(), nothing needs to be 
written, and the call can return 
immediately. The trade-off, of 
course, is that data could be lost in 
between sync() calls. 

Note that temporary databases, 
as you might guess, are always 
writing in deferred mode. 

Tuples and BIND 

Storing things as a byte array is 
powerful but pretty awkward to 
work with. Sure, we could use 
Java's object serialization to trans¬ 
form every object into a byte array 
and back again, but serialization 
has the drawback of being pretty 
slow compared to alternatives 
(partly because it encodes type 
information into the serialized 
byte array, so not only must this 
information be read and writ¬ 
ten every time, it also bloats the 
storage requirements). So Oracle 
Berkeley DB offers another way to 
store (and transform) a collection 
of data elements: theTupleBinding 
and the BIND API. 

Conceptually, a tuple is like a 
lightweight object: a collection of 
data elements that have no name 
associated with them (otherwise 
they'd be object fields). You can 


think of a tuple as an even lighter- 
weight data transfer object or 
parameter object. 

In Oracle Berkeley DB, we can 
use a TupleBinding to describe how 
to put a variety of different ele¬ 
ments into a record by creating a 
custom TupleBinding implementa¬ 
tion to do the reads and writes (see 
Listings 5a and 5b)— sort of like 
a highly specific Serializable that 
requires more work on the devel¬ 
oper's part to implement. 

This is a mouthful, but it's not as 
hard as it might look at first. We're 
looking to store RSSPost objects, 
which are essentially identical to 
the BlogPost objects from Part 1: a 
String title, a String of text, and a 
Date of posting. We want to store 
these RSSPost objects keyed by the 
title of the post. To do so, we need 
TupleBinding objects for both the 
key and the value. 

The first is easy to obtain 
by asking TupleBinding for a 
TupleBinding instance for the 
"primitive" type String. The second 
is harder, because Oracle Berkeley 
DB has no built-in bindings for our 
RSSPost objects; thus, we have to 
create a binding by implement¬ 
ing the TupleBinding interface. 
(Normally, we would probably 
want to do this on the RSSPost 
object itself or as a standalone 
class, but to keep the example 
self-contained, I choose to do it as 
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an anonymousinnerclass.) 

Implementing that interface 
consists of two methods: 

■ One to take the object in 
question and write it to the 
TupleOutput object (for being 
written to the disk) 

■ And anotherto take the 
Tuplelnput (representing what's 
on the disk) and extract the 
fields—in the exact same 
order—into the RSSPost object 
to be returned 

Once those two binding objects 
are in place, the rest is really just 
an exercise in get() and put(), as 
discussed earlier. 

Searching 

All this key-value stuff is great... 
if you already know the key of what 
you're looking for. When you don't, 
or when you wa nt to get a ra nge 
of things, it's not quite so helpful. 
Fortunately, Oracle Berkeley DB 
supports a Cursor API, giving you 
the opportunity to search through 
the records for the values you are 
looking for. 

In theory, the Cursor API is much 
like a for loop: obtain a Cursor 
from the database, tell it to search 
based on a key, and then loop 
through looking for the key-value 
pairs you're searching for. (If you 
just start iterating, it will start with 
the first record in the database and 
give you all the records.) In prac¬ 


tice, though, working with a Cursor 
is a bit trickier than it seems. 

First, to make the sets a little 
easier to work through, let's 
configure the database to sup¬ 
port duplicate records—by 
which we mean records with the 
same keys but different values 
all being stored successfully to 
the database. Doing so requires 
calling setSortedDuplicates(true) 
on the DatabaseConfig object 
before passing it in to obtain the 
Database instance. 

Assumingthat's done, putting a 
bunch of records into the database 
is straightforward, as shown in 
Listing 6. 

Next, to obtain a Cursor, we ask 
the database to give us one, but 
then the Cursor needs to be told to 
search according to a key (which, 
again, must be in the form of a 
DatabaseEntry object). This key, as 
well as the DatabaseEntry that will 
hold the value, must be passed in, 
as shown in Listing 7. 

The Cursor knows how many 
records fit the searched descrip¬ 
tion, and it makes that information 
available to us through the countQ 
method, which makes it easy to 
test whether it found all six of the 
records with the "Ted" key. 

Iterating through the results, 
however, is a little tricky—when 
we call getNext() orgetPrev(), the 
passed-in DatabaseEntry objects 
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■ 

@Test public void storeReadAndRemoveATuple() 
throws java.io.UnsupportedEncodingException 

{ 

RSSPost post = new RSSPostfThe Vietnam of Computer Science", 

"Blah blah blah..."); 

TupleBinding<String> stringBinding = 
TupleBinding.getPrimitiveBinding(String.class); 

TupleBinding<RSSPost> rssbinding = 
newTupleBinding<RSSPost>() { 

public void objectToEntry(RSSPost post, TupleOutput to) { 
to.writeString(post.getTitle()); 
to.writeString(post.getText()); 
to.writeString(post.getPostingDate().toGMTString()); 

} 

public RSSPost entryToObject(Tuplelnputti) { 

RSSPost post = new RSSPostQ; 
post.setTitle(ti.readStringO); 
post.setText(ti.readStringO); 
post.setPostingDate(new Date(ti.readStringO)); 
return post; 

} 

}; 
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are populated with those values, 
but the first key-value pair was 
already fetched into cursorKey and 
cursorValue, so the loop looks a 
little weird (see Listing 8). 

Like most of the other Oracle 
Berkeley DB objects, we have to 


make sure Cursor instances get 
closed. An IllegalStateException 
awaits those who fail to remem¬ 
ber this. 

Curiously enough, if we look in 
the resulting]Unit test text file 
(shown in Listing 9), we see some- 
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thing interesting. Notice 
howallthevaluesare 
nowin lexicographi¬ 
cal order. By default, 

Oracle Berkeley DB will 
sort records via straight 
byte-array value com¬ 
parison, which, in this 
case, works well for 
us. If you ever want to 
change that sort order, 
you can write a custom 
Comparator and hand it 
to the database to use. 

Conclusion 

Obviously, working with the base 
API is not quite as simple as work¬ 
ing with the Direct Persistence 
Layer, but it definitely offers some 
lower-level flexibility in places 
where the DPL does not. In this 
case, we have the advantage that 
the same database can actually 
serve two needs—one as a key- 
value store (similar in some ways 
to Cassandra or BigTable) and 
one as an object storage database 
(similar to object-oriented data¬ 
base management systems such 
as db4o or Versant). 

One way in which the base API 
might be preferable to the higher- 
level APIs is that this form is com¬ 
patible with the original C-based 
Oracle Berkeley DB format. So, 
if a legacy C/C++ UNIX applica¬ 
tion (let's be honest—almost no 


Microsoft Windows 
apps ever knew Oracle 
Berkeley DB existed, 
much less were shipped 
using it) needs to be 
ported to java, the base 
API offers a way to do 
that without requiring 
some kind of explicit 
conversion process in 
the code. 

Despite all the time 
we've spent with Oracle 
Berkeley DB, there's 
still more to know, but we're going 
to have to put it down for now. 
Fortunately, the people working 
on it at Oracle have done a pretty 
good job documenting it, so if 
you're impatient to learn more, 
head on overtothe Oracle Berkeley 
Database documentation page. 

Regardless, knowing that Oracle 
Berkeley DB is there and available 
for use is the end goal. Now you 
know, and as the old 1980s cartoon 
show told us every week, "Knowing 
is half the battle!" </article> 

/learn more 

• Oracle Berkeley DB 


SERIOUS BOOST 


Deferred writes 
offer a huge 
performance 
boost for systems 
whose data 
durability concerns 
aren’t stringent. 
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FIND YOUR 
JUG HERE 

My local and global JUGs are great places 
to network both for knowledge and work. 
My global JUG introduces me to Java 
developers all over the world. 

Regina ten Bruggencate 
JDuchess 
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JOHAN VOS 


DataFX: Populate JavaFX Controls 
with Real-World Data 

DataFX provides tools to retrieve, parse, and render data in a variety of JavaFX controls. 





PHOTOGRAPH BY 
TON HENDRIKS 


T he JavaFX 2 platform 
allows for a clean and 
attractive representation 
of data in different UI con¬ 
trols (for exam pie, ListView, 
TableView, TreeView, Chart, 
and so on). The JavaFX 2 APIs 
provide a number of ways to 
render data, automatically 
visualize changes, and obtain 
user input. This is the clas¬ 
sical CRUD approach that 
most applications require to 
enable users to create, read, 
update, and delete records 
in remote datasources, but 
in most applications, this 
approach requires a lot of 
boilerplate code. 

It's fair to say that a devel¬ 
oper of a domain-specific 
business application often 
wants to focus on the 
domain-specific logic—not 
on the messy code required 
to pull in relevant data—and 
then present the domain- 


specific functionality to users 
in the most useful way. In 
addition, the kind of boiler¬ 
plate code needed for data¬ 
sources is very easy to write 
incorrectly (and, thus, incur 
the wrath of hidden bugs). 
Code for retrieving, parsing, 
processing, and rendering 
data needs to be performant, 
thread-safe, and flexible. 

Fortunately, this is where 
the open source BSD- 
licensed DataFX project 
steps in. DataFX facilitates 
the process of retrieving, 
parsing, and rendering data 
from different sources in dif¬ 
ferent formats into different 
JavaFX controls. 

DataFX contains two com¬ 
plementary major parts: 

■ Datasources provide tools 
to retrieve and parse the 
data. 

■ Cell factories are tools that 
make it easy to render data 


in a number of 
JavaFX controls. 
Combiningthese 
two parts results 
in an end-to-end 
process for retriev¬ 
ing, parsing, and 
rendering the data 
into a simple-to- 
useyet very power¬ 
ful API. 

We'll now delve 
extensively into 
both areas. 

Note: The full 
code for the exam¬ 
ple described in 
this article can be 
found here. 


Datasources 

The first part of DataFX is 
focused on retrieving and 
parsing data. The second 
part concentrates on cell 
factories and facilitates the 
process of visualizing the 


parsed data to 
the controls; the 
second part will 
be covered later in 
this article. 

The Java platform 
already contains 
a numberof APIs 
that allow devel¬ 
opers to obtain 
data from differ¬ 
ent sources, with a 
numberof libraries 
providing conve¬ 
nient approaches 
for doing so. 

There are two 
important char¬ 
acteristics of the 
JavaFX platform that should 
be considered when dealing 
with remote data: 

■ The Observable and 
ObservableList interfaces. 
These JavaFX interfaces 
allow for changes in data 
to immediately notify 


MAKING IT EASIER 


DataFX facilitates 
the process of 

retrieving, 
parsing, and 
rendering data 

from different 
sources in 
different formats 
into different 
JavaFX controls. 
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interested listeners, including 
UI controls. Instead of a single 
blocking get call, lists should 
be populated and data should 
be added when itis available. 
During this process, the user 
interface has to remain respon¬ 
sive. In fact, many UI controls 
automatically add listeners to 
the underlying datasource and 
automatically update the dis¬ 
play when the data changes. 

■ Threading. All operations 
that modify the scene graph 
should be initiated from the 
JavaFX application thread. 
Hence, adding a data entry to 
an ObservableList should be 
done usingthe JavaFX applica¬ 
tion thread. On the other hand, 
data retrieval should not block 
the responsiveness of the user 
interface. The JavaFX Worker 
interface and the Service and 
Task classes provide interesting 
possibilities in this area. 

Data that is rendered in JavaFX 
controls can have different ori¬ 


gins, protocols, and characteris¬ 
tics. The DataFX API provides two 
concepts with a clear separation 
between them: 

■ The org.javafxdata.datasources 
.reader package contains the 
DataSourceReader interface and 
a numberof implementations 
and builders. 

■ The org.javafxdata.datasources 
.provider package contains a 
numberof DataSource provider 
interfaces, implementations, 
and builders. 

The DataSourceReader abstracts 
the origin of the data (for exam¬ 
ple, a file, a network resource, 
or plain Java objects), while the 
DataSource abstracts the protocol 
of the data (for example, JavaScript 
Object Notation [JSON], XML, and 
Java objects) and of the destina¬ 
tion (for example, Plain Old Java 
Objects [POJOs] for populating an 
ObservableList and String values for 
populatingTableColumn instances). 

The link between a 
DataSourceReader, the providers, 


Reader 


Provider 


File Source 
Network source 
Java Object Source 


-XML 

-JSON 

-Java Objects 




Format: 


Object Datasource 
XML Datasource 


ObjectProvider 


ListProvider 


TableProvider 



Figure 1 
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LISTING 1 


A 


RestRequestBuilder rrb = new RestRequestBuilder 
("http://search.twi tter.com"). path ("search. rss").queryParam 
("q", "javafx"); 

DataSourceReader dataSourceReader = rrb.build(); 
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and the controls is shown in 

Figure 1. 

We will explain the flow by 
writing a small application that 
q ueries the Twitter API for tweets 
containing the term JavaFX and 
then renders those tweets in a 
ListView and a TableView. 
DataSourceReader. DataSource 
Reader is an interface providing an 
InputStream that will be used by a 
DataSource. Different implementa¬ 
tions of DataSourceReader will have 
their own specific mechanisms for 
obtaining data and creating the 
InputStream. The DataSource does 
not need to worry about the origin 
of the InputStream. 

Currently, DataFX contains 
three implementations of 
DataSourceReader: 

■ FileSource provides data read 
from the file system. 

■ NetworkSource provides data 
read from the network. 

■ JavaObjectSource provides an 
ObjectlnputStream containing 
Java objects. 

These implementation classes 


can be used directly by developers. 

DataFX contains a 
RestRequestBuilder class that 
allows developers to use the 
builder pattern to create a 
NetworkSource in a way that is 
familiar to Java API for RESTful 
Web Services (JAX-RS) developers. 
Indeed, many of today's business 
applications obtain their data from 
a Representational State Transfer 
(REST) service, in either JSON or 
XML. The RestRequestBuilder helps 
developers in making a call to a 
REST endpoint and in obtaining 
the resulting data. 

The code in Listing 1 creates 
a NetworkSource that will pro¬ 
vide data obtained by calling the 
Twitter search API. 

The RestRequestBuilder con¬ 
structor takes the host name of the 
REST endpoint as a parameter. The 
complete path toward the end- 
pointis added by calling the path() 
method. This method can be called 
more than once, and the path 
segments will be added to each 
other. Query parameters can be 
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specified using the queryParam() 
method, and form parameters can 
be specified using the formParaimQ 
method. 

By default, a NetworkSource cre¬ 
ated with the RestRequestBuilder 
will use the GET operation, but 
the methodQ method can be used 
to specify a POST, PUT, 
or DELETE operation 
as well. 

Calling the build() 
method on the 
RestRequestBuilder cre¬ 
ates the NetworkSource. 

Note that at this 
stage, there is not yet 
a connection to the 
remote endpoint. 

The NetworkSource 
.getlnputStreamO 
method will initiate 
the connection to the 
REST endpoint. 

The implementa¬ 
tion classes in the org 
.javafxdata.datasources 
.provider package 
use the InputStream 
provided by the 
DataSourceReader 
.getlnputStreamO method. Those 
classes are completely agnos¬ 
tic with respect to where the 
InputStream originates from. This 
makes it easy to use, for example, 
a FileSource containing some XML 
orJSON data during testing and a 


NetworkSource containing similar 
XML orJSON data obtained via a 
REST call for production. 

Creating a "test file" containing 
tweets can be done easily using a 
command-line tool such as Curl. 

In Linux, you would create a file 
containing tweets about JavaFX as 
shown in Listing 2. 

The file my tweets 
.xml can now be used 
astheinputfora 
FileSource, as shown in 
Listing 3. 

Although the 
DataSourceReader 
implementations 
are not dependent 
on the format of the 
data they deliver, they 
should be able to tell 
what format the data 
is in. Therefore, the 
constructors in the 
implementations 
allow for developers 
to specify the for¬ 
mat of the expected 
response data, and 
the RestRequestBuilder 
contains a formatf) method that 
allows developers to specify 
the format (XML, JSON, or Java 
objects). 

DataSource providers. The next 
steps in populating the JavaFX 
control are to parse the data and 
add tweets to the items in the 


CODE HELPER 


Code for retrieving, 
parsing, processing, 
and rendering 
data needs to be 

performant, 
thread-safe, 
and flexible. 

Fortunately, this 
is where the open 
source BSD-licensed 
DataFX project 


steps in. 
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A 


curl "http://search.twitter.com/search.rss7q =javafx" > 
/tm p/ mytweets.xm I 
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ListView and the TableView. These 
steps will use the data obtained 

in the DataSourceReader. There 
is no difference between the two 
approaches we just discussed (a 
NetworkSource containing data 
obtained via a REST endpoint ver¬ 
sus a FileSource containing static 
data on a file system). 

The org.javafxdata.datasources 
.provider package contains a num¬ 
ber of interfaces and a number of 
implementations and builders. 
There are a few criteria that deter¬ 
mine which implementation class 
works best in a given context: 

■ Incoming protocol: The 
ObjectDataSource class supports 
XML, JSON, and serialized Java 
objects. Other implementations 
might support other protocols. 

■ Outgoing format: Some devel¬ 
opers prefer to work with real 
Java objects, whereas oth¬ 
ers can live with XML. The 
ObjectDataSource converts 
incoming data into real Java 
objects. The XmlDataSource 
keeps an XMLdocument about 
the incoming data and will pro¬ 
vide the JavaFX controls with the 


required values by parsing the 

XML without converting it into a 

Java object. 

■ Consumer: 

■ A DataSource that implements 
ObjectProvider provides gen¬ 
eral data that is observable. 

■ A DataSource implement¬ 
ing ListProvider extends this 
ObjectProvider, and specifically 
provides an ObservableList 

of objects. Clearly, this is 
the appropriate interface 
when you want to populate a 
ListView. 

■ Finally, a DataSource imple¬ 
menting TableProvider extends 
ListProvider and adds meth¬ 
ods for setting and retrieving 
column information. This is 
what is needed for populating 
a TableView. 

In orderto create ourTwitter 
example, we need an implementa¬ 
tion that can handle XMLorJSON 
(Twitter supports both). We will 
use the XMLformat in this exam¬ 
ple, but using JSON is equally easy. 

The consumer of the 
data is either a ListView or a 
TableView. We will show how 
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this can easily be accomplished 
using the ObjectDataSource. 
ObjectDataSource implements 
TableProvider —and thus also 
ListProvider— and can work with 
XML and JSON. 

The ObjectDataSourceBuilderin 
the org.javafxdata.datasources 
.provider package is a convenience 
class that assists developers in cre¬ 
ating an ObjectDataSource. 

The code in Listing4 will create 
an ObjectDataSource and populate 
the ObservableList allTweets with 
the incoming tweets. 

Note that we introduce a class 
named Tweet here, which is a POJO 
holding the data for a single tweet. 
Again, we are not required to use 
this POJO approach, but in case we 
want to use the Tweet concepts 
somewhere else in the applica¬ 
tion, a specific class is useful. The 
code for the Tweet class is shown 
in Listing 5. 

After creating an 
ObjectDataSourceBuilder, we use 
the fluent API to give instructions 
about the ObjectDataSource we 
want to create: 

■ The parsed entries should be 
converted to instances of Tweet. 

■ The data should be obtained 
from the DataSourceReader we 
just created. 

■ Incoming tweets are in XML ele¬ 
ments named item. 

■ The resulting entries should 


be added to an existing 
ObservableList named allTweets. 

■ When the retrieved enti¬ 
ties should be rendered by a 
TableView, we are interested 
only in the authorand title parts 
of the tweet, not in the publica¬ 
tion date. 

Next, the ObjectDataSource is 
created. Data is not retrieved until 
the DataSource.retrieve!) method 
is called. All implementationsin 
the org.javafxdata.datasources 
.provider classes will immedi¬ 
ately return when this method is 
called. Retrieving and parsing data 
is handled in a background task 
using the JavaFX Service concept. 
Therefore, it is important that the 
retrieve!) method is called from the 
JavaFX application thread. 

When data is obtained and 
parsed into entries, those 
entries are added to the desired 
ObservableList. If an existing 
ObservableList is supplied using 
the ObjectDataSourceBuilder, it 
will be used. Otherwise, a new, 
initially empty ObservableList will 
be created and populated as soon 
as entries are parsed. The result¬ 
ing ObservableList can be obtained 
at any point using the getData!) 
method on the ObjectDataSource. 

A DataSource also contains a 
runningProperty, which is a con¬ 
venience property for indicating 
whether this DataSource is still 
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ObjectDataSource createDataSource() { 
RestRequestBuilder rrb = 

new RestRequestBuilder("http://search.twitter.com") 
.path("search.rss") 

.queryParam("q", "javafx"); 

DataSourceReader dataSourceReader = rrb.build (); 
ObjectDataSourceBuilder<Tweet> builder = 
ObjectDataSourceBuilder.<Tweet>create(); 
builder.itemClass(Tweet.class) 

.dataSourceReader(dataSourceReader) 

.itemTag("item") 

.resultList(allTweets) 

.columns("author", "title"); 

ObjectDataSource dataSource = builder.build (); 
return dataSource; 

} 
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Tue. IGJul 2012 12:16:52 +OOQO-skrb@twitter.com (Yuichi Sakuraba): @c_mo5java 

Tue, lOJul 2012 10:58:43 +0000-kormy a_atsushi@twrtter.com (KOMIYA Atsushi): Ja> 

Tue. 10 Ju 2012 10:55:30 +0000-,avajimLondcn@twitter.com tjim Gough): This wee 

Tue, 10 Ju) 2012 07:42:58 +0000-c_mos@twitter.cam (c.mos): jsvaFX, UlcCSS*^ 

Tue. 10 Ju. 2012 06:30:00 +0000-johanvos@twitter.com (Johan Vos): Writing more s 

Tue, lOJul 2012 05:45:55 +00004rof@twitter.com @mrke_neckJavaFX*?^ 

Tue, 10 Ju! 2012 05:37:06 +QOOO-AndyAHCP@tw itter.com (Andy Moncsek): RT @car 
Option 5 is nice! 

Tue, 10 Ju! 2012 03 :42:20 +0000-d ausonjava@twitter.com (Claus]: RT @William_An 
Tue, 10 Ju 2012 03:37:55 +0000-paukoronel@tw tter.com (Paul Coronel}; RT @Wil 
Tue. 10 |ul 2012 03:20:41 +0000-Wilfiam Antonio@twitter.com (William Antonio): @ 

Figure 2 


list table 

author 


skrb@twitter.com {Yuichi Sakuraba) 

@c_mos JavaFXc; 

komiya_atsushi@twitter.com (KOMIYA Atsushi) 

javaFX i *+>* h 

JavajimLondon@twitter.com (jim Gough) 

This weekend is e 

c_mos@twitter.com (c.mos) 

javaFX, Ult:CSS< 

johanvo5@twitter.com (Johan Vos) 

Writing more sarr 

irof@twitter.com A,) 

@mike_neck java 

AndyAHCP@twitte'.conn (Andy Moncsek) 

RT @carldea: Re- 
Option 5 is nice! 

clausonjava@twitter.com (Claus) 

RT @William_Ant< 

paulcoronel@twitter.com (Paul Coronel) 

RT @William_Anti 

Wifli-am Antrsni n/fht 1 .*! \tt or rr,m ‘ W i Ifi airtAnf nmnl_ 

fnW/la4smif\/i\;iQn i 


Figure 3 


actively processing data. 

Note that calling the retrieveQ 
method on ObjectDataSource 
returns the background Service 
object that is reading and pars¬ 
ing the entries. As a consequence, 
progress on this process can also 


be followed and queried using the 
existing properties on Service (that 
is, stateProperty). 

The same ObjectDataSource 
can be used for a ListView and a 
TableView. Our example shows a 
TabPane with two tabs: one con- 
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void buildListTab(Tab t) { 

ListView listView = new ListView(allTweets); 
t.setContent(listView); 

} 


Download all listings in this issue as text 


taining a ListView and the other 
containing a TableView. 

The relevant code for populat¬ 
ing the ListView is now very simple 
(see Listing 6). The allTweets field 
is the ObservableList instance that 
is filled by the ObjectDataSource. 

Populating the TableView and 
defining which columns to show 
is done with the code shown in 
Listing 7. A part from populating 
the TableView with the allTweets 
list, we also populate the columns 
with theTableColumn instances 
returned by the datasource. 

The results of the combined 
code from Listing 6 and Listing7 
are shown in Figure 2 and Figure 3. 

Cell Factories 

TheJavaFX controls allow for a 
clear separation between the 
physical parts of the control (for 
example, a Cell in a ListView or a 
TableView) and the content ren¬ 
dered in the control. The "glue" 


between the content and the rep¬ 
resentation of the content in the 
cell is provided by factories. 

A ListView has a cellFactory prop¬ 
erty, and a TableView has a List of 
TableColumn instances that each 
has a cellFactory property as well. 
Alternatively, a TableView also has 
a rowFactory property. 

Let's look at the ListView fi rst. 
The cellFactoryProperty on the 
ListView is obtained as shown in 
Listing 8. 

The Callback interface declares a 
single method: 

I public interface Callback<P,R> 

Rcall (P param) 

A custom cellFactory, therefore, 
has to provide a Callback imple¬ 
mentation, with a call method 
accepting a ListView<T> parameter 
and returning a ListCell<T> value: 

I ListCell<T> call (ListView<T>) 
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Figure 4 
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Figure 5 


UsingTableRow instances in a 
TableView, the situation is simi¬ 
lar. The rowFactoryProperty on 
TableView is obtained as shown in 

Listing 9. 

If we want to provide a 
rowFactory, we have to create a 
Callback implementation with a 
call method that is declared as 
follows: 

I TableRow<S> call (TableView<S>) 

However, rowFactory is rarely 
used. Instead, the preferred 
approach on TableView is to 
install cell factories into each 
TableColumn instance. As the 
name states, a TableColumn is 
responsible for managing the 
contents of a single column in a 
TableView. 


Each TableColumn contains 
a cellFactory property that is 
obtained as shown in Listing 10. 

If we want to provide a custom 
implementation for a cellFactory 
fora particular column in a table, 
we have to create an implementa¬ 
tion of a Callback class definingthe 
following call method: 

I TableCell<S,T> call 
(TableColumn<S,T>) 

Although all of this is doable, it 
frequently tends to require a rela¬ 
tively high amount of boilerplate 
code compared to the desired 
outcome. 

Therefore, DataFX contains a 
number of predefined cell facto¬ 
ries. Some of the cell factories that 
are currently in JavaFX 2.2 were 
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LISTING 10 / LISTING 11 / LISTING 12 


public final 

ObjectProperty<Callback<TableView<S>,TableRow<S>>> 

rowFactoryProperty 


Download all listings in this issue as text 


first started in DataFX and moved 
to the JavaFX 2 repository later. 

The DataFX repository contains 
useful but experimental cell facto¬ 
ries that have not yet made it into 
the JavaFX 2 repository. 

Cell factory example. As a n exa m - 
pie, we show the MoneyCel I Factory 
here. Consider the code in 
Listing 11. This simple example will 
create a ListView without speci¬ 
fying a cellFactory. The resulting 
ListView will look like Figure4. 

If we want the numbers in this 
list to represent money, we can 
leverage the MoneyCel I Factory by 
adding the single line shown in 
Listing 12. The output now looks 
like Figure 5. 

Like all cell factories in DataFX, 
the MoneyCellFactory provides 
methods for creating cell fac¬ 
tories for ListView as well as for 
TableColumn instances. 

Developers don't have to worry 
about creating implementations of 
the Callback interface, making sure 
they have the right parameters in 
the correct order, and so on. 


Conclusion 

We have seen how DataFX pro¬ 
vides tools that enable developers 
to effectively retrieve, parse, and 
render data in a variety of JavaFX 
controls with code that is perfor- 
mant, thread-safe, and flexible. 

DataFX has two complementary 
major parts: 

■ Datasources provide tools to 
retrieve and parse the data. 

■ Cell factories are tools that 
make it easy to render data in a 
number of JavaFX controls. 

The lives of JavaFX developers 

should get a little bit easier 
as they learn to deploy these 
tools. </article> 

/ LEARN MORE 

• DataFX 

• The DataFX project 

• DataFX source code repository 
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THE 
FUTURE 
OF GRAAL 

Oracle Labs’ Dr. Thomas Wuerthinger 

explains the goals of the Graal Project. 

BY JANICE J.HEISS 










T he Graal Project, 

which is run by Oracle 
Labs, aspires to 
implement a dynamic com¬ 
piler in java that produces 
excellent code quality with¬ 
out compromising compile 
time and memory usage in 
the java Virtual Machine 
(JVM). The result could 
be a seamless integration 
between application and 
virtual machine (VM). The 
project is run by Thomas 
Wuerthinger, who is senior 
member of the techni¬ 
cal staff at Oracle Labs. 
Wuerthinger received his 
PhD in computer science in 
2011 from Johannes Kepler 
University in Linz, Austria. 
Previously, he worked on 
the IdealGraphVisualizer, 
the Crankshaft/V8 opti¬ 
mizing compiler, and the 
Dynamic Code Evolution 
VM. We met with him to 
get an update on develop¬ 
ments in Graal. 


PHOTOGRAPHY BY BOB ADLER 
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SUPPORT FOR ALL 

“Supporting multiple 

languages is a main 
goal of Graal. We 
want to provide the 
capabilities of the 
Java platform for all 
languages.” 


Java Magazine: WhatdoestheGraal 
Project hope to accomplish? 
Wuerthinger: In brief, the project is "a 
quest for the JVM to leverage its own J." 
We want to create a VM in which major 
components are written in Java so that 
they can benefit from Java's safe exe¬ 
cution model and tooling. 
Also, the modulardesign 
of the Graal VM aims at 
improving extensibility 
and maintainability. 

Java Magazine: H o w f a r 
along are you in reaching 
your goal? 

Wuerthinger: A main focus 
of the project so far has 
been to develop interfaces 
forthe Graal VM so that 
it can be easily extended. 
This should encourage 
people to experiment with 
the VM and in that way 
contribute to our vision. Additionally, 
we have developed a prototype of a 
dynamic compilerfor Java that pro¬ 
vides a peak performance that lies 
between the client and the server con¬ 
figuration of the JHotSpot VM. Like the 
Jjkes RVM [Research Virtual Machine] 
or the Maxine VM, our system shows 
that it is possible to write system soft¬ 
ware using the java language. 

Java Magazine: It's argued that the 
Graal compilerwill allowjava librar¬ 
ies to exte n d th ei r fu n cti o n a Iity i n 
ways not currently possible, so that 
more new languages can be efficiently 
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implemented. Can you give us some 
details about this? For example, which 
new languages will be implemented? 
Wuerthinger: Supporting multiple 
languages is a main goal of Graal. We 
want to provide the capabilities of the 
Java platform for all languages. In par¬ 
ticular, we developed a multilanguage 
framework that allows language 
implementers to focus on implement¬ 
ing the semantics of their language 
without worrying about compiler or 
VM details. The semantics of the lan¬ 
guage are specified by a Java program 
that implements an AST [abstract 
syntax tree] interpreter for that lan¬ 
guage. We developed a technique that 
enables the Graal compilerto deliver 


high-performance execution for lan¬ 
guages implemented in that frame¬ 
work. We developed prototypes for a 
few languages in orderto shape the 
API, and we invite language imple¬ 
menters to give this framework a try. 
Java Magazine: Why should the aver¬ 
age Java developer, looking ahead a 
few years, care about Graal? What 
might it enable them to do that they 
cannot do now? 

Wuerthinger: The Graal project is 
more experimental than many other 
OpenJDK projects. Therefore, we can¬ 
not make promises that what we do 
will eventually be shipped as a product 
Still, we believe that the Graal proj¬ 
ect will be a positive contribution and 
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Wuerthinger (third from right) with several 
of the PhD students who are contributing 
to the Graal project at Johannes Kepler 
University in Linz, Austria 


PHOTOGRAPH COURTESY OF JOHANNES KEPLER UNIVERSITY 


help keep the Java ecosystem vibrant 
over the next few years. In particular, 
we expect Graal to help us learn more 
about howto leverage the Java lan¬ 
guage within the JVM. This could lead 
to both performance improvements 
for Java itself as well as better support 
for additional languages. 

Also, the flexibility of Graal should 
enable its application in a wide range 
of different domains including cloud 
infrastructure, heterogeneous com¬ 
puting environments, and embedded 
devices. We want to make sure that 
Java continues to stand up to its slo¬ 
gan, "Write once, run everywhere." 

Java Magazine: Whatshouldd eve I o p - 
ers who are interested in Graal do? 
Wuerthinger: We want to keep the 
entry barrierto Graal development as 
low as possible. Therefore, we have 
placed a small description on howto 
build and run Graal on the front page of 
our project. Also, we encourage devel¬ 
opers to join our OpenJDK ma i ling li st. 
Once a week, the changes to the Graal 
code base are posted to that list. 

Java Magazine :The GraaI project claims 
as one of its goals leveraging Java within 
the VM. What are some of the specific 
advantages and challenges involved in 
writing parts oftheJVMinJava? 
Wuerthinger: A main advantage is 
improved robustness by executing the 
compilerin a managed environment. 
This means that an errorin the com¬ 
piler could, for example, lead to a null 
pointer exception instead of crashing 


the VM process. Also, we can make 
use of Java reflection and annotations. 
There is no language barrier between 
the compiler and the application, mak¬ 
ing it a lot easierfor Java applications 
to influence or extend the compiler. 
There are challenges in two areas: We 
must make sure ourcompileris mem¬ 
ory efficient and does not degrade 
garbage collection performance. Also, 
the compiler has to be precompiled in 
orderto enable a fast startup. 

Java Magazine: Whatappealstoyou 
about working with Graal? 
Wuerthinger: I like working on system 
software while still having all the tool¬ 
ing and benefits of programming in 
Java. Also, I enjoy having the ability to 
do free-spirited experiments on the 
JVM. The experimental nature of the 
project allows us to try new approaches 
without being immediately restricted 
by practical barriers. Additionally, I 
like working on the Graal team, which 
consists of a mix between experienced 
developers and curious master's and 
PhD Students! </article> 


Janice J. Heiss is the Java acquisitions 
editor at Oracle and a technology editor at 
Jovo Magazine. 
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//fix this / 



In 4ke. CK*ly/A<A5<As4 Z01Z *isst\e, U<ASO^\ 

Hnn4er And Boris SpnkpA4 presen4ed ns W t 4u a 
connec4ion pooling code ci^Allenge. Tkey gAve o\s a 
4rimmed code snippe4 from 4pe pool cIass And Asked ns 
4o -fix i4 w/,4(^ova4 a •'nAjor (redesign. 

Tke correc4 Answer ’is 4f t 4- Tke Connec4ionpool.jAvA code erroneously 
Assumed 4 pa 4 k'ASUvCodeO And £epAAls() WOlAld no4 be overbidden. 

Tke npgrAde 4° A new driver broke 4p£ progrAm beCAiASe 4p£ new 
in\plen\en4^4’iOn implemen4ed e^n^lsC) vising objec4 eopnixAlenCe 
ins4e<xd of 4ke defAnl4 reference e^yvAl'Hy. Tpe ApproAci^ in #4 
Allow/s ws 4° mAke owr program Absoln4ely independen4 -from 
implemen4^4ions of U/\skCode() And e^yvAlsQ. Tke soln4ion is 
4o cre^4e a sAfe implemen4^4i°n of 4pe < Connec4ton m4erfAce 
WrAppmg 4p£ r£A( LTonnec4iOn tmplemen4A4iOn And rowing CAlls 
4o i4 in4ernAlly so 4k^4 4pe program will Always (ASe o<nr objec4 ; s 
reliable PAstXCode() And e^yvAls() me4pods. 

Tpis issue’s ci^Allenge comes -from S4eppen Cpin, a Hava EvAngelis4 
a 4 Oracle And coAvHpor of Pro ^Ja\zaFX 2 (Apress, 2012). 


1 THE PROBLEM 


Tpe UavaFX MediA APIs mAke if very eAsy \o Add video 
con4en4 4o yowr deskfop ApplicAfion. Wpile 4pe APIs Are 

ojyvife Hep 4 Pis Also meAns 4 pa 4 fpere Are sever Al cl Asses 
involved, so i4 CAn be eAsy 4° ge4 simple nse ca ses wrong 14 

yOK a Are no 4 CAre-fvvl. 


Z THE COPE 

- — 



Hint: The builder syntax 
is great, but sometimes 
it can hide the obvious. 


In 4Pis code snippe4 4rom fpe ApplicAfion sfArf mefpod o-f fpe 
MediAQv\i 2 cIass, CAn yow iden4i4y wpy 4pe video clip does no4 plAy? 

stage.setScene(SceneBuilder.create() 

.width(960).height(540) 

.root( 

StackPaneBuilder.create().children( 
new MediaView( 

new MediaPlayer( 
new Media( 

getClass () .getResource("quiz.mp4") .toString())))) 

.build()) 

.build()); 
stage.show(); 

I <ASed 4pe -following source lAyowf: 

■ org 

■ s4eveonjAvA 

■ MediAQwiz.jAvA 

■ oj.vviz.mpM 

3 WHATS THE FIX? 

1) Tpe resource pAfp is wrong 4or loAding 4pe mediA Ale- 

2) OavaFX 2 does no4 snpporf H-2G4 encoded video. 

3) Tpere is a missing confvol fiAncfion 4° enAble fpe video. 

*4) Tpe MediAView wonf be visible wifpowf 4pe proper S4ACkpAne 
lAyow4 cons4^A’m4s sef- 



ART BY l-HUA CHEN 


THE ANSWER? 

Loor -fW 4He Av\swe« in 4He ne*4 tss^e. CV s<Abn\i4 yow own co<de cpAllen^e! 
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